May 13 04:09:12.145544 np0000000669 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: we strongly recommend against using it for new projects.
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: If you are already using Eventlet, we recommend migrating to a different
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: framework.  For more detail see
May 13 04:09:12.433613 np0000000669 nova-compute[97951]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:09:12.433613 np0000000669 nova-compute[97951]:   import eventlet
May 13 04:09:13.900806 np0000000669 nova-compute[97951]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=97951) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 04:09:13.901221 np0000000669 nova-compute[97951]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=97951) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 04:09:13.901221 np0000000669 nova-compute[97951]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=97951) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 04:09:13.901343 np0000000669 nova-compute[97951]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 13 04:09:14.025275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:09:14.036154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:09:14.083556 np0000000669 nova-compute[97951]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 13 04:09:14.945215 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 13 04:09:14.945612 np0000000669 nova-compute[97951]: INFO nova.utils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] The long task thread pool MainProcess.long_task is initialized
May 13 04:09:14.945612 np0000000669 nova-compute[97951]: INFO nova.virt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 13 04:09:15.032046 np0000000669 nova-compute[97951]: INFO nova.compute.provider_config [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 13 04:09:15.534477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Acquiring lock "singleton_lock" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:09:15.534612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Acquired lock "singleton_lock" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:09:15.534736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Releasing lock "singleton_lock" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:09:15.534886 np0000000669 nova-compute[97951]: WARNING oslo_service.backend._threading.service [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] no_fork=True: running service in main process
May 13 04:09:15.535135 np0000000669 nova-compute[97951]: INFO nova.service [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Starting compute node (version 33.1.0)
May 13 04:09:16.039755 np0000000669 nova-compute[97951]: INFO nova.utils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] The default thread pool MainProcess.default is initialized
May 13 04:09:16.040599 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:09:16.040832 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Starting event thread {{(pid=97951) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 13 04:09:16.041159 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Starting connection event dispatch thread {{(pid=97951) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 13 04:09:16.041975 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Connecting to libvirt: qemu:///system {{(pid=97951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 13 04:09:16.639725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7a4652013470> {{(pid=97951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 13 04:09:16.641119 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7a4652013470> {{(pid=97951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 13 04:09:16.641900 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Connection event '1' reason 'None'
May 13 04:09:17.144508 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Cannot update service status on host "np0000000669" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000669 could not be found.
May 13 04:09:17.144886 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.mount [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Initialising _HostMountState generation 0 {{(pid=97951) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 13 04:09:27.142838 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host capabilities <capabilities>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:   <host>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     <uuid>d26a2911-da70-41c4-bf1f-498a5fdc91e4</uuid>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     <cpu>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <arch>x86_64</arch>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <model>EPYC-Milan</model>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <microcode version='16777317'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <signature family='25' model='1' stepping='1'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <maxphysaddr mode='emulate' bits='40'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='x2apic'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='tsc-deadline'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='osxsave'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='hypervisor'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='tsc_adjust'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='ospke'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='vaes'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='vpclmulqdq'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='spec-ctrl'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='stibp'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='arch-capabilities'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='ssbd'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='cmp_legacy'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='topoext'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='stibp-always-on'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='virt-ssbd'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='amd-psfd'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='lbrv'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='tsc-scale'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='vmcb-clean'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='flushbyasid'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='pause-filter'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='pfthreshold'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='v-vmsave-vmload'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='vgif'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='no-nested-data-bp'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='lfence-always-serializing'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='null-sel-clr-base'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='rdctl-no'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='skip-l1dfl-vmentry'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='mds-no'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='pschange-mc-no'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <feature name='gds-no'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <pages unit='KiB' size='4'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <pages unit='KiB' size='2048'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <pages unit='KiB' size='1048576'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     </cpu>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     <power_management/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     <iommu support='no'/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     <migration_features>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <live/>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       <uri_transports>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:         <uri_transport>tcp</uri_transport>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:         <uri_transport>rdma</uri_transport>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:       </uri_transports>
May 13 04:09:27.142838 np0000000669 nova-compute[97951]:     </migration_features>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:     <topology>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <cells num='1'>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:         <cell id='0'>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <memory unit='KiB'>24607192</memory>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <pages unit='KiB' size='4'>6151798</pages>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <pages unit='KiB' size='2048'>0</pages>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <pages unit='KiB' size='1048576'>0</pages>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <distances>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <sibling id='0' value='10'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           </distances>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           <cpus num='12'>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:           </cpus>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:         </cell>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       </cells>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:     </topology>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:     <cache>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 13 04:09:27.144347 np0000000669 nova-compute[97951]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     </cache>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <secmodel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <model>apparmor</model>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <doi>0</doi>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     </secmodel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <secmodel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <model>dac</model>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <doi>0</doi>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     </secmodel>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:   </host>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <arch name='alpha'>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>clipper</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:     <arch name='armv6l'>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>borzoi</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>spitz</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>nuri</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-b1</machine>
May 13 04:09:27.145029 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatileab</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>kzm</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-a</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>smdkc210</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>z2</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tosa</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>sabrelite</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-eb</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n810</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n800</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 04:09:27.146044 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatilepb</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>terrier</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mainstone</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>integratorcp</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>midway</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>musicpal</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>microbit</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='3'>fby35</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cubieboard</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>verdex</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>bpim2u</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduino2</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>raspi2b</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cheetah</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 04:09:27.146950 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>highbank</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>akita</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>connex</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>collie</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi0</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:     <arch name='armv7l'>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>borzoi</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>spitz</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>nuri</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-b1</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatileab</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>kzm</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-a</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 04:09:27.147723 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>smdkc210</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>z2</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tosa</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>sabrelite</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-eb</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n810</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n800</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatilepb</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>terrier</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mainstone</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>integratorcp</machine>
May 13 04:09:27.148670 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>midway</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>musicpal</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>microbit</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='3'>fby35</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cubieboard</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>verdex</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>bpim2u</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduino2</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>raspi2b</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cheetah</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>highbank</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>akita</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>connex</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>collie</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi0</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 04:09:27.149483 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:     <arch name='aarch64'>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>borzoi</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>spitz</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>nuri</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-b1</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatileab</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>kzm</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>musca-a</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>smdkc210</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 04:09:27.150164 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>z2</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>tosa</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>sabrelite</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-eb</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>sbsa-ref</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n810</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>n800</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>versatilepb</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>terrier</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mainstone</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>integratorcp</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 04:09:27.151060 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>midway</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>musicpal</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>microbit</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='3'>fby35</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>raspi3ap</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cubieboard</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>verdex</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>bpim2u</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduino2</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>raspi3b</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>raspi2b</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>cheetah</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>highbank</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>akita</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>connex</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>collie</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>raspi0</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <acpi default='on' toggle='yes'/>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.151726 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     <arch name='cris'>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>axis-dev88</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:     <arch name='i686'>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 13 04:09:27.152437 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>x-remote</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 13 04:09:27.153290 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>isapc</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 13 04:09:27.153932 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>microvm</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 13 04:09:27.154563 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <domain type='kvm'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <pae/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <nonpae/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <acpi default='on' toggle='yes'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <apic default='on' toggle='no'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <arch name='m68k'>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mcf5208evb</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-7.0</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>an5206</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-6.0</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>q800</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-8.1</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-7.2</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-6.2</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-8.0</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>next-cube</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-7.1</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-6.1</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virt-8.2</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <arch name='microblaze'>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:     <arch name='microblazeel'>
May 13 04:09:27.155183 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <arch name='mips'>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>malta</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mipssim</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <arch name='mipsel'>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>malta</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mipssim</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <arch name='mips64'>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>malta</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mipssim</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>pica61</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>magnum</machine>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:     <arch name='mips64el'>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 13 04:09:27.156260 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>malta</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>loongson3-virt</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mipssim</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>pica61</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>magnum</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='16'>boston</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>fuloong2e</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <arch name='ppc'>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g3beige</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>amigaone</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mac99</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ppce500</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sam460ex</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>pegasos2</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>bamboo</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>40p</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ref405ep</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:     <arch name='ppc64'>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-noble</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>amigaone</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv9</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 13 04:09:27.157394 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv10</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ppce500</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>40p</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>pegasos2</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>bamboo</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-focal</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g3beige</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-disco</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 13 04:09:27.158300 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mac99</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-impish</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-artful</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sam460ex</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ref405ep</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv8</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:     <arch name='ppc64le'>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-noble</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>amigaone</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv9</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv10</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ppce500</machine>
May 13 04:09:27.159416 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>40p</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>pegasos2</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>bamboo</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-focal</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>g3beige</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-disco</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>mac99</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-impish</machine>
May 13 04:09:27.160293 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-artful</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sam460ex</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>ref405ep</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='2048'>powernv8</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <arch name='riscv32'>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='8'>spike</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>opentitan</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='5'>sifive_u</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sifive_e</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <arch name='riscv64'>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='512'>virt</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='8'>spike</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='5'>sifive_u</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>shakti_c</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sifive_e</machine>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:     <arch name='s390x'>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 13 04:09:27.160946 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 13 04:09:27.162088 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <arch name='sh4'>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>shix</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>r2d</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <arch name='sh4eb'>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>shix</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>r2d</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:     <arch name='sparc'>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>SS-5</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>SS-20</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>LX</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>SPARCClassic</machine>
May 13 04:09:27.162740 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>leon3_generic</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>SPARCbook</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>SS-4</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>SS-600MP</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>SS-10</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>Voyager</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <arch name='sparc64'>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sun4u</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>niagara</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>sun4v</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:     <arch name='x86_64'>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <wordsize>64</wordsize>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 13 04:09:27.163724 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>x-remote</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 13 04:09:27.164605 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='1'>isapc</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 13 04:09:27.165202 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>microvm</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 13 04:09:27.165733 np0000000669 nova-compute[97951]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <domain type='kvm'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <acpi default='on' toggle='yes'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <apic default='on' toggle='no'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <arch name='xtensa'>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>sim</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>kc705</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ml605</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ml605-nommu</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>virt</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx60-nommu</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx200</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx200-nommu</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx60</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>kc705-nommu</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:   <guest>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <os_type>hvm</os_type>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:     <arch name='xtensaeb'>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <wordsize>32</wordsize>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='4'>sim</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>kc705</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ml605</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>ml605-nommu</machine>
May 13 04:09:27.166478 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>virt</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx60-nommu</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx200</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx200-nommu</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>lx60</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <machine maxCpus='32'>kc705-nommu</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <domain type='qemu'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     </arch>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <features>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <cpuselection/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <deviceboot/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <disksnapshot default='on' toggle='no'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <externalSnapshot/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     </features>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   </guest>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]: </capabilities>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]: 
May 13 04:09:27.167417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.167417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 13 04:09:27.167417 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-alpha</path>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <machine>clipper</machine>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <arch>alpha</arch>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <vcpu max='4'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.167417 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.168536 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.169836 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.169836 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 13 04:09:27.169836 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-arm</path>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <machine>virt-8.2</machine>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <arch>armv6l</arch>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.169836 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 04:09:27.170891 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.171472 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <gic supported='yes'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       <enum name='version'>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>2</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:         <value>3</value>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     </gic>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.172577 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.173907 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 13 04:09:27.173907 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-arm</path>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <machine>virt-8.2</machine>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <arch>armv6l</arch>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 04:09:27.173907 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.174777 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.175461 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <gic supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='version'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>2</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>3</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </gic>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.176551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.176551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 13 04:09:27.176551 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-arm</path>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <machine>virt-8.2</machine>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <arch>armv7l</arch>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.176551 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 04:09:27.177561 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.178181 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     <gic supported='yes'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       <enum name='version'>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>2</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:         <value>3</value>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.179195 np0000000669 nova-compute[97951]:     </gic>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.180518 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.180518 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 13 04:09:27.180518 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-aarch64</path>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <machine>virt-8.2</machine>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <arch>aarch64</arch>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 13 04:09:27.180518 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 13 04:09:27.181359 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.181811 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:     <gic supported='yes'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:       <enum name='version'>
May 13 04:09:27.182712 np0000000669 nova-compute[97951]:         <value>2</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>3</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     </gic>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.183931 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.183931 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 13 04:09:27.183931 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-cris</path>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <machine>axis-dev88</machine>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <arch>cris</arch>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.183931 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.184837 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.186259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.186259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 13 04:09:27.186259 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-i386</path>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <machine>pc-i440fx-noble</machine>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <arch>i686</arch>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <vcpu max='255'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.186259 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='lm'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 04:09:27.188096 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.189335 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.190233 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.191408 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.192606 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 13 04:09:27.192606 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-i386</path>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <machine>pc-q35-noble</machine>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <arch>i686</arch>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <vcpu max='1024'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.192606 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='lm'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.194049 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.194810 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.195338 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.196290 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.197945 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 13 04:09:27.197945 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-i386</path>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <machine>pc-q35-noble-v2</machine>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <arch>i686</arch>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <vcpu max='1024'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.197945 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='lm'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.199111 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.199859 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.200379 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.201802 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.203045 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 13 04:09:27.203045 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-i386</path>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <machine>pc-i440fx-noble-v2</machine>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <arch>i686</arch>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <vcpu max='255'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.203045 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='lm'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.204250 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.204936 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.205530 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.206399 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.207692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.207692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 13 04:09:27.207692 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-m68k</path>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <machine>mcf5208evb</machine>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <arch>m68k</arch>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.207692 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.208618 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.209977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 13 04:09:27.209977 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-m68k</path>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <machine>virt-8.2</machine>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <arch>m68k</arch>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.209977 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.211686 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.212973 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.212973 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 13 04:09:27.212973 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-microblaze</path>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <machine>petalogix-s3adsp1800</machine>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <arch>microblaze</arch>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.212973 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.213948 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.215173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.215173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 13 04:09:27.215173 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <machine>petalogix-s3adsp1800</machine>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <arch>microblazeel</arch>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.215173 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.216186 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.217618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.217618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 13 04:09:27.217618 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-mips</path>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <machine>malta</machine>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <arch>mips</arch>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <vcpu max='16'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.217618 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.218679 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.219786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.219786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 13 04:09:27.219786 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-mipsel</path>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <machine>malta</machine>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <arch>mipsel</arch>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <vcpu max='16'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.219786 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.220808 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.222085 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.222085 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 13 04:09:27.222085 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-mips64</path>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <machine>malta</machine>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <arch>mips64</arch>
May 13 04:09:27.222085 np0000000669 nova-compute[97951]:   <vcpu max='16'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.223562 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.224898 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.226530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.226530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 13 04:09:27.226530 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-mips64el</path>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <machine>malta</machine>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <arch>mips64el</arch>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <vcpu max='16'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.226530 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.228065 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.229604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.229604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 13 04:09:27.229604 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc</path>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <machine>g3beige</machine>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <arch>ppc</arch>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.229604 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.230818 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.232222 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.232222 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 13 04:09:27.232222 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <machine>pseries-noble</machine>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <arch>ppc64</arch>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <vcpu max='4096'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.232222 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.233918 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>tpm-spapr</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>spapr-tpm-proxy</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.235314 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.236390 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 13 04:09:27.236390 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <machine>pseries-noble</machine>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <arch>ppc64</arch>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <vcpu max='4096'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.236390 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>tpm-spapr</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>spapr-tpm-proxy</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.237442 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.238611 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 13 04:09:27.238611 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <machine>powernv9</machine>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <arch>ppc64</arch>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <vcpu max='2048'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.238611 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.239615 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>tpm-spapr</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>spapr-tpm-proxy</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.240772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.240772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 13 04:09:27.240772 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 13 04:09:27.240772 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <machine>pseries-noble</machine>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <arch>ppc64le</arch>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <vcpu max='4096'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.241800 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>tpm-spapr</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>spapr-tpm-proxy</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.242836 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.244466 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 13 04:09:27.244466 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <machine>powernv9</machine>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <arch>ppc64le</arch>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <vcpu max='2048'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.244466 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>tpm-spapr</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:         <value>spapr-tpm-proxy</value>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.245485 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.246684 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.246684 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 13 04:09:27.246684 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-riscv32</path>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <machine>virt</machine>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <arch>riscv32</arch>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.246684 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.247716 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.248901 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.250123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.250123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 13 04:09:27.250123 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-riscv64</path>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <machine>virt</machine>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <arch>riscv64</arch>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <vcpu max='512'/>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>any</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.250123 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.250906 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.252146 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.252146 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 13 04:09:27.252146 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-s390x</path>
May 13 04:09:27.252146 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <machine>s390-ccw-virtio-noble</machine>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <arch>s390x</arch>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <vcpu max='248'/>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.3</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.2</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.4</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z196</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z114-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen16b</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen16a</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.5</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z196.2</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zEC12</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9BC</model>
May 13 04:09:27.253242 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13.2</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14.2</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z196-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z800</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>max</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen15b</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen15a</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z114</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13s</model>
May 13 04:09:27.254166 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890.3</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890.2</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z890-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z10BC</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>zBC12</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z990-base</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.254906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <s390-pv supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.255870 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.257140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.257140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 13 04:09:27.257140 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-sh4</path>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <machine>shix</machine>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <arch>sh4</arch>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.257140 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.258082 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.259399 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.259399 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 13 04:09:27.259399 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <machine>shix</machine>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <arch>sh4eb</arch>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.259399 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.260403 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.261741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.261741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 13 04:09:27.261741 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-sparc</path>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <machine>SS-5</machine>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <arch>sparc</arch>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.261741 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <redirdev supported='no'/>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.262793 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='model'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.264049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.264049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 13 04:09:27.264049 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-sparc64</path>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <machine>sun4u</machine>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <arch>sparc64</arch>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <vcpu max='1'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.264049 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.265105 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.266415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.266415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 13 04:09:27.266415 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <machine>pc-i440fx-noble</machine>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <arch>x86_64</arch>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <vcpu max='255'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 04:09:27.266415 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.267450 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.268266 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.268873 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.269623 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.270828 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 13 04:09:27.270828 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <machine>pc-q35-noble</machine>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <arch>x86_64</arch>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <vcpu max='1024'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.270828 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.272029 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 04:09:27.272986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.273554 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.274271 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.275396 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.275396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 13 04:09:27.275396 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <machine>pc-q35-noble-v2</machine>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <arch>x86_64</arch>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <vcpu max='1024'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.276905 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.277877 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.278463 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.279111 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.280243 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.281347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 13 04:09:27.281347 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <machine>pc-i440fx-noble-v2</machine>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <arch>x86_64</arch>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <vcpu max='255'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     <enum name='firmware'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <value>efi</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='yes'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <enum name='maximumMigratable'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>on</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:         <value>off</value>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='yes'>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <model fallback='forbid'>EPYC</model>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <vendor>AMD</vendor>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='acpi'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='ss'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='monitor'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='hypervisor'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='erms'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='mpx'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='pcommit'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='clwb'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='umip'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='pku'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='vaes'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='la57'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='rdpid'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='pks'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrm'/>
May 13 04:09:27.281347 np0000000669 nova-compute[97951]:       <feature policy='require' name='fzrm'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrs'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='fsrc'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnowext'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='3dnow'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='xsaveerptr'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='wbnoinvd'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='npt'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='vgif'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='require' name='svme-addr-chk'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='vme'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='xsavec'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='fxsr_opt'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='misalignsse'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='osvw'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='topoext'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <feature policy='disable' name='nrip-save'/>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:     <mode name='custom' supported='yes'>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 04:09:27.282366 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 04:09:27.282986 np0000000669 nova-compute[97951]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <model usable='yes' vendor='unknown'>486</model>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </mode>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>ide</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>vmvga</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>qxl</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>ramfb</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.283497 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <tpm supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>tpm-tis</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>tpm-crb</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>passthrough</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>emulator</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>external</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='backendVersion'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>1.2</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>2.0</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </tpm>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='yes'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <genid supported='yes'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:     <hyperv supported='yes'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       <enum name='features'>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>relaxed</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>vapic</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>spinlocks</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>vpindex</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>runtime</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>synic</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>stimer</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>reset</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>vendor_id</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>frequencies</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>reenlightenment</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>tlbflush</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>ipi</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:         <value>avic</value>
May 13 04:09:27.284604 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     </hyperv>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.285867 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.285867 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 13 04:09:27.285867 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-xtensa</path>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <machine>sim</machine>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <arch>xtensa</arch>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <vcpu max='4'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.285867 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.286906 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.288111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=97951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 04:09:27.288111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 13 04:09:27.288111 np0000000669 nova-compute[97951]: <domainCapabilities>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <domain>qemu</domain>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <machine>sim</machine>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <arch>xtensaeb</arch>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <vcpu max='4'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <iothreads supported='yes'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <os supported='yes'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <enum name='firmware'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <loader supported='yes'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>rom</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>pflash</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <enum name='readonly'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>yes</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <enum name='secure'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:         <value>no</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     </loader>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   </os>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <cpu>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <mode name='host-passthrough' supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <mode name='maximum' supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <mode name='host-model' supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <mode name='custom' supported='no'/>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   <memoryBacking supported='yes'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     <enum name='sourceType'>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <value>file</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <value>anonymous</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:       <value>memfd</value>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:     </enum>
May 13 04:09:27.288111 np0000000669 nova-compute[97951]:   </memoryBacking>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:   <devices>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <disk supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='diskDevice'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>disk</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>cdrom</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>floppy</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>lun</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>fdc</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>sata</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </disk>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <graphics supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>sdl</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>vnc</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>spice</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>egl-headless</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>dbus</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <video supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='modelType'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>vga</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>cirrus</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>none</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>bochs</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </video>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <hostdev supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='mode'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>subsystem</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='startupPolicy'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>default</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>mandatory</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>requisite</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>optional</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='subsysType'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>pci</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>scsi</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='capsType'/>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='pciBackend'/>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </hostdev>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <rng supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio-transitional</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtio-non-transitional</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>random</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>egd</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </rng>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <filesystem supported='yes'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       <enum name='driverType'>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>path</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>handle</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:         <value>virtiofs</value>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     </filesystem>
May 13 04:09:27.289029 np0000000669 nova-compute[97951]:     <tpm supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <redirdev supported='yes'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       <enum name='bus'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>usb</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     </redirdev>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <channel supported='yes'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>pty</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>unix</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>spicevmc</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     </channel>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <crypto supported='yes'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       <enum name='model'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>virtio</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       <enum name='type'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>qemu</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       <enum name='backendModel'>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:         <value>builtin</value>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:       </enum>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     </crypto>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:   </devices>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:   <features>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <gic supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <vmcoreinfo supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <genid supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <backingStoreInput supported='yes'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <backup supported='yes'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <async-teardown supported='yes'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <sev supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:     <sgx supported='no'/>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:   </features>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]: </domainCapabilities>
May 13 04:09:27.290229 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 04:09:27.290229 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Checking secure boot support for host arch (x86_64) {{(pid=97951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 13 04:09:27.290229 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Checking secure boot support for host arch (x86_64) {{(pid=97951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 13 04:09:27.290229 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Checking secure boot support for host arch (x86_64) {{(pid=97951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 13 04:09:27.290229 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Secure Boot support detected
May 13 04:09:27.747699 np0000000669 nova-compute[97951]: INFO nova.virt.node [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Generated node identity 7fc6428b-bc57-40b4-8243-357124d5276c
May 13 04:09:27.747960 np0000000669 nova-compute[97951]: INFO nova.virt.node [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Wrote node identity 7fc6428b-bc57-40b4-8243-357124d5276c to /opt/stack/data/nova/compute_id
May 13 04:09:28.250142 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Compute nodes ['7fc6428b-bc57-40b4-8243-357124d5276c'] for host np0000000669 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 13 04:09:29.253761 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 13 04:09:30.258114 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] No compute node record found for host np0000000669. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000669 could not be found.
May 13 04:09:30.258552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:09:30.258552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:09:30.258552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:09:30.258691 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:09:30.315557 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:09:30.316250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:09:30.332862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:09:30.333232 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=16677MB free_disk=75.24382400512695GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:09:30.333435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:09:30.333904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:09:30.836742 np0000000669 nova-compute[97951]: WARNING nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] No compute node record for np0000000669:7fc6428b-bc57-40b4-8243-357124d5276c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7fc6428b-bc57-40b4-8243-357124d5276c could not be found.
May 13 04:09:31.341400 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Compute node record created for np0000000669:np0000000669 with uuid: 7fc6428b-bc57-40b4-8243-357124d5276c
May 13 04:09:32.848388 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:09:32.848388 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:09:30 up 23 min,  2 users,  load average: 3.02, 1.78, 0.88\n'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:09:33.283343 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] [req-3419ef65-d16b-416d-b049-487d75a182af] Created resource provider record via placement API for resource provider with UUID 7fc6428b-bc57-40b4-8243-357124d5276c and name np0000000669.
May 13 04:09:33.333314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 13 04:09:33.333314 np0000000669 nova-compute[97951]: ] {{(pid=97951) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 13 04:09:33.333467 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.host [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] kernel doesn't support AMD SEV
May 13 04:09:33.333662 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:09:33.333831 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:09:33.334101 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:09:33.338164 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Libvirt baseline CPU <cpu>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:   <arch>x86_64</arch>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:   <model>Nehalem</model>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:   <vendor>AMD</vendor>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:   <topology sockets="12" cores="1" threads="1"/>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:   <maxphysaddr mode="emulate" bits="40"/>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]: </cpu>
May 13 04:09:33.338164 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 13 04:09:33.902388 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Updated inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 13 04:09:33.902785 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Updating resource provider 7fc6428b-bc57-40b4-8243-357124d5276c generation from 0 to 1 during operation: update_inventory {{(pid=97951) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 13 04:09:33.902785 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:09:34.037456 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Updating resource provider 7fc6428b-bc57-40b4-8243-357124d5276c generation from 1 to 2 during operation: update_traits {{(pid=97951) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 13 04:09:34.545178 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:09:34.545442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.212s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:09:34.545598 np0000000669 nova-compute[97951]: DEBUG nova.service [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=97951) start /opt/stack/nova/nova/service.py:195}}
May 13 04:09:34.563462 np0000000669 nova-compute[97951]: DEBUG nova.service [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=97951) start /opt/stack/nova/nova/service.py:211}}
May 13 04:09:34.580336 np0000000669 nova-compute[97951]: DEBUG nova.service [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] Join ServiceGroup membership for this service compute {{(pid=97951) start /opt/stack/nova/nova/service.py:221}}
May 13 04:09:34.580486 np0000000669 nova-compute[97951]: DEBUG nova.servicegroup.drivers.db [None req-c81c3595-25a1-4111-894b-a0f54c9b0c41 None None] DB_Driver: join new ServiceGroup member np0000000669 to the compute group, service = <Service: host=np0000000669, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=97951) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 13 04:09:40.083898 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:09:56.582420 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:09:57.085007 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:09:57.086142 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:10:14.085016 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.085495 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.085649 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.085921 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.086165 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.086435 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.086691 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.086900 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:10:14.087107 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:10:14.590692 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:10:14.590856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:10:14.590973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:10:14.591083 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:10:14.598281 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:10:14.598919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:10:14.611023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:10:14.611460 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=16429MB free_disk=75.11249160766602GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:10:14.611630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:10:14.611819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:10:15.659856 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:10:15.660202 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:10:14 up 24 min,  2 users,  load average: 1.84, 1.64, 0.87\n'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:10:15.698305 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:10:15.698528 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:10:16.200948 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:10:16.706461 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:10:16.706956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.095s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:10:16.706956 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:11:16.700275 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.700969 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.701140 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.701832 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.701832 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.702094 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.702209 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.702443 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:16.702619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:11:16.702826 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:11:17.206652 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:17.206897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:17.207046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:17.207206 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:11:17.218745 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:11:17.219701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:17.237898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:17.238245 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=16066MB free_disk=74.97317123413086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:11:17.238500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:17.238780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:18.288241 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:11:18.288622 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:11:17 up 25 min,  2 users,  load average: 1.44, 1.55, 0.90\n'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:11:18.334067 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:11:18.334450 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:11:18.836881 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:11:19.343834 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:11:19.343834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.105s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:19.344619 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:11:36.718960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:36.719440 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:37.221612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:37.798648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:37.799076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:37.801637 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:11:37.801851 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Claim successful on node np0000000669
May 13 04:11:38.932762 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:11:38.933226 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:11:39.436253 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:11:39.942369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.143s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:39.942815 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:11:40.086475 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:11:40.449376 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:11:40.450601 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:11:40.453723 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:40.453723 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:40.951553 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:11:41.456642 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:11:41.886113 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799034b9ffd74e119275abbe08f36d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424a63b8c033439491bb333cc25998a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:11:42.463915 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:11:42.465342 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:11:42.465659 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Creating image(s)
May 13 04:11:42.466343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:42.466680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:42.467575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:42.468147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:42.468558 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:42.766702 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:42.768943 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:42.769227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:42.847277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.part --force-share --output=json" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:42.847870 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] 21f6dd9f-a6e8-4103-9a88-7de2ff01268f was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:11:42.849972 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:11:42.850313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.part /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:42.989993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.part /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.converted" returned: 0 in 0.139s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:42.995435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:43.066967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d.converted --force-share --output=json" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:43.068103 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.599s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:43.069005 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:43.075197 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:43.075765 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe543_3su/privsep.sock']
May 13 04:11:43.083621 np0000000669 sudo[109228]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe543_3su/privsep.sock
May 13 04:11:43.084385 np0000000669 sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 04:11:43.333457 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 04:11:43.333571 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:11:43.333617 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:11:43.333743 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:43.333803 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:11:43.333803 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:11:43.333803 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:11:43.334004 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:43.334136 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 04:11:43.672336 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:43.672725 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 04:11:43.901013 np0000000669 sudo[109228]: pam_unix(sudo:session): session closed for user root
May 13 04:11:43.902364 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Spawned new privsep daemon via rootwrap
May 13 04:11:43.903261 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 13 04:11:43.903335 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 13 04:11:43.903422 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 13 04:11:43.903464 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109233
May 13 04:11:43.985053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:44.055256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.070s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:44.055739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:44.056335 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:44.056812 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:44.060344 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:44.060716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:44.119358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:44.119960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:44.149069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk 1073741824" returned: 0 in 0.029s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:44.149605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.093s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:44.149983 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:44.231227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.081s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:44.231690 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:11:44.232141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:44.301997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:44.302718 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Cannot resize image /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:11:44.303499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:11:44.303740 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Ensure instance console log exists: /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:11:44.304108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:44.305361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:44.305361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:44.626962 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Successfully created port: a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:11:45.207130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:45.207605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:45.709958 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:46.265497 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:46.265925 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:46.268289 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:11:46.268438 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Claim successful on node np0000000669
May 13 04:11:46.693851 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Successfully updated port: a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:11:47.195865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:47.196027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquired lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:11:47.196174 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:11:47.361312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-changed-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:11:47.361312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Refreshing instance network info cache due to event network-changed-a937a9d4-108b-43af-977e-16b3c9f0d378. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:11:47.361312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] Acquiring lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:47.409987 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:11:47.410286 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:11:47.913005 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:11:48.420480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.155s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:48.420963 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:11:48.523271 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:11:48.926859 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:11:48.927079 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:11:48.927615 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:48.927921 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:49.430575 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:11:49.469756 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cffc8fad0694442ad05ced625bbe1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c2202127ca4ec4a872d2af2f5e4576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:11:49.933953 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:11:50.274988 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:50.944447 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:11:50.945440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:11:50.945535 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Creating image(s)
May 13 04:11:50.946014 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:50.946196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:50.946652 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:50.947126 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:50.950783 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:50.952082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:50.969156 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updating instance_info_cache with network_info: [{"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:11:51.025179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:51.028412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:51.028412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:51.028412 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:51.030793 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:51.031444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:51.095965 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:51.096423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:51.130719 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk 1073741824" returned: 0 in 0.034s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:51.131352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.104s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:51.131717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:51.212905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.080s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:51.213343 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:11:51.213588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:51.273134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:51.273353 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Cannot resize image /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:11:51.273620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:11:51.273816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Ensure instance console log exists: /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:11:51.274102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:51.274334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:51.274464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:51.473198 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Releasing lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:11:51.473299 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Instance network_info: |[{"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:11:51.473623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] Acquired lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:11:51.473796 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Refreshing network info cache for port a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:11:51.477574 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Start _get_guest_xml network_info=[{"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:11:51.480489 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:11:51.486894 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-2077667566', uuid='2a54ab5b-821c-46cc-80bb-49baec8f1a36'), owner=OwnerMeta(userid='799034b9ffd74e119275abbe08f36d71', username='tempest-DeleteServersTestJSON-69299131-project-member', projectid='424a63b8c033439491bb333cc25998a9', projectname='tempest-DeleteServersTestJSON-69299131'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645511.4842355) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:11:51.488819 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:11:51.489225 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:11:51.492526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:11:51.492771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:11:51.494932 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:11:51.495575 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:11:51.495778 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:11:51.495900 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:11:51.496070 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:11:51.496171 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:11:51.496298 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:11:51.496537 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:11:51.496657 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:11:51.497075 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:11:51.497222 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:11:51.497401 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:11:51.512474 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:11:51.513587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2077667566',display_name='tempest-DeleteServersTestJSON-server-2077667566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-deleteserverstestjson-server-2077667566',id=1,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424a63b8c033439491bb333cc25998a9',ramdisk_id='',reservation_id='r-uet50n95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-69299131',owner_user_name='tempest-DeleteServersTestJSON-69299131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:41Z,user_data=None,user_id='799034b9ffd74e119275abbe08f36d71',uuid=2a54ab5b-821c-46cc-80bb-49baec8f1a36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:11:51.513778 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converting VIF {"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:11:51.515991 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:11:51.517196 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a54ab5b-821c-46cc-80bb-49baec8f1a36 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:11:51.521367 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Successfully created port: 455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:11:51.979484 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:52.026462 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] End _get_guest_xml xml=<domain type="qemu">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <uuid>2a54ab5b-821c-46cc-80bb-49baec8f1a36</uuid>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <name>instance-00000001</name>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:name>tempest-DeleteServersTestJSON-server-2077667566</nova:name>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:11:51</nova:creationTime>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:user uuid="799034b9ffd74e119275abbe08f36d71">tempest-DeleteServersTestJSON-69299131-project-member</nova:user>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:project uuid="424a63b8c033439491bb333cc25998a9">tempest-DeleteServersTestJSON-69299131</nova:project>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         <nova:port uuid="a937a9d4-108b-43af-977e-16b3c9f0d378">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <system>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="serial">2a54ab5b-821c-46cc-80bb-49baec8f1a36</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="uuid">2a54ab5b-821c-46cc-80bb-49baec8f1a36</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </system>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <os>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </os>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <features>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </features>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   <devices>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </disk>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.config"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </disk>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:08:dc:42"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <target dev="tapa937a9d4-10"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </interface>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/console.log" append="off"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </serial>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <video>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </video>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </rng>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:   </devices>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]: </domain>
May 13 04:11:52.026462 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:11:52.030552 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Preparing to wait for external event network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:11:52.030552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:52.030552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:52.030552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:52.030552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2077667566',display_name='tempest-DeleteServersTestJSON-server-2077667566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-deleteserverstestjson-server-2077667566',id=1,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424a63b8c033439491bb333cc25998a9',ramdisk_id='',reservation_id='r-uet50n95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-69299131',owner_user_name='tempest-DeleteServersTestJSON-69299131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:41Z,user_data=None,user_id='799034b9ffd74e119275abbe08f36d71',uuid=2a54ab5b-821c-46cc-80bb-49baec8f1a36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:11:52.030900 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converting VIF {"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:11:52.030900 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:11:52.030900 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:11:52.080650 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Created schema index Interface.name {{(pid=97951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 04:11:52.080822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Created schema index Port.name {{(pid=97951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 04:11:52.081001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Created schema index Bridge.name {{(pid=97951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 04:11:52.081333 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:11:52.081786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [POLLOUT] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.081786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:11:52.082205 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.083884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.104677 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.121078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.121238 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:52.121447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:11:52.122071 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.122272 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '791e218b-062d-5419-afdd-93109044d5a7', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:52.123077 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.123853 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:11:52.124269 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:52.125570 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpht6516qp/privsep.sock']
May 13 04:11:52.132398 np0000000669 sudo[109346]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpht6516qp/privsep.sock
May 13 04:11:52.133085 np0000000669 sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 04:11:52.414967 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 04:11:52.415107 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:11:52.415107 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:11:52.415214 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:52.415258 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:11:52.415909 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:11:52.415909 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:11:52.416100 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:52.416100 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 04:11:52.531975 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Successfully updated port: 455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:11:52.763375 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 04:11:52.763518 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:11:52.763518 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:11:52.763617 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:52.763617 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:11:52.763617 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:11:52.763727 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:11:52.763727 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:11:52.763817 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 04:11:53.035523 np0000000669 sudo[109346]: pam_unix(sudo:session): session closed for user root
May 13 04:11:53.038429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:53.038429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:11:53.038429 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:11:53.039103 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Spawned new privsep daemon via rootwrap
May 13 04:11:53.040315 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 13 04:11:53.040315 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 13 04:11:53.041553 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 13 04:11:53.041553 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109353
May 13 04:11:53.369028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:53.369402 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa937a9d4-10, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:53.369844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa937a9d4-10, col_values=(('qos', UUID('0c4d29e3-3cb7-494d-827a-d3e2a3cdee08')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:53.370694 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa937a9d4-10, col_values=(('external_ids', {'iface-id': 'a937a9d4-108b-43af-977e-16b3c9f0d378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:dc:42', 'vm-uuid': '2a54ab5b-821c-46cc-80bb-49baec8f1a36'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:53.372555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:53.373742 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:11:53.380103 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:53.383672 np0000000669 nova-compute[97951]: INFO os_vif [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10')
May 13 04:11:53.657097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:53.657304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:53.731365 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:11:53.731365 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing instance network info cache due to event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:11:53.731503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] Acquiring lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:53.801407 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:11:53.847298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:53.847494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:54.160643 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:54.182869 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:54.277290 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:54.280178 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:54.349408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:54.582013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:54.582199 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:54.585798 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updated VIF entry in instance network info cache for port a937a9d4-108b-43af-977e-16b3c9f0d378. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:11:54.586266 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updating instance_info_cache with network_info: [{"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:11:54.598985 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:54.623877 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:54.735382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:54.735605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:54.738517 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:11:54.738679 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Claim successful on node np0000000669
May 13 04:11:54.832756 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:11:54.901811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:11:54.901941 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:11:54.902208 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No VIF found with MAC fa:16:3e:08:dc:42, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:11:54.905419 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Using config drive
May 13 04:11:54.906480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:55.083927 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:55.089834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f419cd0-1dc2-425e-870f-24315cc69e55 req-ad86f7ca-1582-4a80-b790-8936ff28769a service nova] Releasing lock "refresh_cache-2a54ab5b-821c-46cc-80bb-49baec8f1a36" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:11:55.334831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:11:55.335205 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Instance network_info: |[{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:11:55.335547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] Acquired lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:11:55.335686 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:11:55.337845 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Start _get_guest_xml network_info=[{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:11:55.340333 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:11:55.341674 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-615490902', uuid='8d2f3521-15f2-4140-9561-7798bbe03f60'), owner=OwnerMeta(userid='7cffc8fad0694442ad05ced625bbe1ad', username='tempest-ServerActionsTestOtherA-1572513959-project-member', projectid='03c2202127ca4ec4a872d2af2f5e4576', projectname='tempest-ServerActionsTestOtherA-1572513959'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645515.3413334) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:11:55.342899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:11:55.343499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:11:55.345041 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:11:55.345251 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:11:55.346349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:11:55.346771 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:11:55.346997 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:11:55.347122 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:11:55.347300 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:11:55.347458 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:11:55.347748 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:11:55.347988 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:11:55.348540 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:11:55.348709 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:11:55.348864 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:11:55.349989 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:11:55.366374 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615490902',display_name='tempest-ServerActionsTestOtherA-server-615490902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-615490902',id=2,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-vwpz1ve9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=8d2f3521-15f2-4140-9561-7798bbe03f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:11:55.366952 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:11:55.368544 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:11:55.368544 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d2f3521-15f2-4140-9561-7798bbe03f60 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:11:55.410282 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:55.635729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:55.705920 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Creating config drive at /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.config
May 13 04:11:55.708810 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg02iqv37 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:55.742723 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg02iqv37" returned: 0 in 0.034s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:55.840425 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:55.872714 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] End _get_guest_xml xml=<domain type="qemu">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <uuid>8d2f3521-15f2-4140-9561-7798bbe03f60</uuid>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <name>instance-00000002</name>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherA-server-615490902</nova:name>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:11:55</nova:creationTime>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:user uuid="7cffc8fad0694442ad05ced625bbe1ad">tempest-ServerActionsTestOtherA-1572513959-project-member</nova:user>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:project uuid="03c2202127ca4ec4a872d2af2f5e4576">tempest-ServerActionsTestOtherA-1572513959</nova:project>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         <nova:port uuid="455a1a1b-3a1c-4b13-b24d-e88a7707574f">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <system>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="serial">8d2f3521-15f2-4140-9561-7798bbe03f60</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="uuid">8d2f3521-15f2-4140-9561-7798bbe03f60</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </system>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <os>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </os>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <features>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </features>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   <devices>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </disk>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.config"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </disk>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:0d:ee:a2"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <target dev="tap455a1a1b-3a"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </interface>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/console.log" append="off"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </serial>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <video>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </video>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </rng>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:   </devices>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]: </domain>
May 13 04:11:55.872714 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:11:55.875635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Preparing to wait for external event network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:11:55.875635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:55.875635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:55.875635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:55.875635 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615490902',display_name='tempest-ServerActionsTestOtherA-server-615490902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-615490902',id=2,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-vwpz1ve9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=8d2f3521-15f2-4140-9561-7798bbe03f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:55.875975 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:11:55.876538 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.876689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa48ad5c-76ef-55d5-9c24-2df58cb7e556', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:55.877657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.878373 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:11:55.885445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.888353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.888353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap455a1a1b-3a, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:55.888569 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap455a1a1b-3a, col_values=(('qos', UUID('7efe80ff-782a-488a-8b4c-c2a0acec6dc9')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:55.888839 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap455a1a1b-3a, col_values=(('external_ids', {'iface-id': '455a1a1b-3a1c-4b13-b24d-e88a7707574f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ee:a2', 'vm-uuid': '8d2f3521-15f2-4140-9561-7798bbe03f60'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:11:55.889787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.891169 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:11:55.901053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:55.901852 np0000000669 nova-compute[97951]: INFO os_vif [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a')
May 13 04:11:56.032124 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:11:56.032379 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:11:56.189750 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:56.218298 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:56.311165 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:56.324754 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:56.340069 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:56.536561 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:11:56.658146 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updated VIF entry in instance network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:11:56.658414 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:11:56.852525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:57.051730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.316s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:57.052288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:11:57.055550 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.150s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:57.062231 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:11:57.062460 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Claim successful on node np0000000669
May 13 04:11:57.066186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:57.073348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:57.073348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:57.162505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bff66a30-8b84-4370-a3c0-84a058a22c6d req-5ad7c7eb-e102-4898-86d6-3d31dcfdd1ad service nova] Releasing lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:11:57.226218 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778645517.2259045, 2a54ab5b-821c-46cc-80bb-49baec8f1a36 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:11:57.226536 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] VM Started (Lifecycle Event)
May 13 04:11:57.276216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:57.276390 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:57.419831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:11:57.420168 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:11:57.420168 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:0d:ee:a2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:11:57.420545 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Using config drive
May 13 04:11:57.560605 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:11:57.560782 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:11:57.561032 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:57.561225 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:57.574257 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:57.654430 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05518f5e677e49a5ba493f2452458bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81cc9d369e54af591916abb970b9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:11:57.729024 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:11:57.732420 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645517.7307212, 2a54ab5b-821c-46cc-80bb-49baec8f1a36 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:11:57.732420 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] VM Paused (Lifecycle Event)
May 13 04:11:57.782429 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:11:57.928177 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:11:58.063287 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:11:58.103775 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Creating config drive at /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.config
May 13 04:11:58.108722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3f36ap_ {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:58.143226 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3f36ap_" returned: 0 in 0.034s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:58.167071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:58.201581 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Successfully created port: cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:11:58.234870 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:11:58.238633 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:11:58.346275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:58.567505 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:11:58.574075 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:11:58.574268 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:11:58.689501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.710882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.742763 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:11:58.809997 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.901269 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Successfully updated port: cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:11:58.922137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.926040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.931969 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:58.947237 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquired lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-changed-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Refreshing instance network info cache due to event network-changed-cecb70b9-1b26-46ff-857c-098779b38f4f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:11:59.559918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] Acquiring lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:11:59.576643 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:11:59.577578 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:11:59.577668 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Creating image(s)
May 13 04:11:59.578114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:59.578270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:59.578698 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:59.579310 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:59.583114 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:59.585190 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:59.597361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.541s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:59.599884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.962s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:59.600293 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645519.5978246, 8d2f3521-15f2-4140-9561-7798bbe03f60 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:11:59.600693 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:11:59.605307 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] VM Started (Lifecycle Event)
May 13 04:11:59.610589 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:11:59.610709 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Claim successful on node np0000000669
May 13 04:11:59.666481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.081s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:59.669041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:59.669041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:59.669041 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:59.672134 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:11:59.672650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:59.693296 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.694931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.697346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.713523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:11:59.753908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.081s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:59.754484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:59.787882 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk 1073741824" returned: 0 in 0.033s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:59.788354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.121s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:59.788646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:59.850716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.061s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:59.851660 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:11:59.851789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:11:59.915436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:11:59.915436 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Cannot resize image /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:11:59.915436 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:11:59.915436 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Ensure instance console log exists: /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:11:59.915673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:11:59.915931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:11:59.916204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:11:59.980209 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:00.120076 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:00.120185 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:00.120623 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:00.120983 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:00.125031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:00.131144 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645520.1295292, 8d2f3521-15f2-4140-9561-7798bbe03f60 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:00.131144 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] VM Paused (Lifecycle Event)
May 13 04:12:00.170036 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:00.228313 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4620f9393254d1c9e0db0ff59cbedf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ee7976e72845ffbdd292d619a145af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:00.322522 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updating instance_info_cache with network_info: [{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:00.623519 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 13 04:12:00.633049 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:00.635783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:00.681676 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Successfully created port: eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:00.824876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Releasing lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:00.825338 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Instance network_info: |[{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:00.825457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] Acquired lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:00.827337 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Start _get_guest_xml network_info=[{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:00.827337 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Refreshing network info cache for port cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:00.832090 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:00.833667 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1807434522', uuid='f35e1e76-19d7-4055-920e-ec4242cd9619'), owner=OwnerMeta(userid='05518f5e677e49a5ba493f2452458bda', username='tempest-VolumesAssistedSnapshotsTest-346714218-project-member', projectid='c81cc9d369e54af591916abb970b9d70', projectname='tempest-VolumesAssistedSnapshotsTest-346714218'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645520.8331444) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:00.835132 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:00.835677 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:00.836339 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:00.836581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:00.837599 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:00.837910 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:00.838071 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:00.838127 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:00.838301 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:00.838592 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:00.838748 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:00.838977 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:00.839133 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:00.839300 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:00.839480 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:00.839652 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:00.858802 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1807434522',display_name='tempest-VolumesAssistedSnapshotsTest-server-1807434522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesassistedsnapshotstest-server-1807434522',id=3,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIef/eDoM7VoX6DfjnmTVBcR2X6dCRXiubuNZFlwLS+Qt+bSGKljJI82J7M4sV4QKMFN0ilYv0QoiMSLywnaDVKa8OMSkAE3FeHNOhOeLTLisPkgc74z1A9uPlMzXQ3eHg==',key_name='tempest-keypair-516633706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c81cc9d369e54af591916abb970b9d70',ramdisk_id='',reservation_id='r-19pj15vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-346714218',owner_user_name='tempest-VolumesAssistedSnapshotsTest-346714218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05518f5e677e49a5ba493f2452458bda',uuid=f35e1e76-19d7-4055-920e-ec4242cd9619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:00.859029 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converting VIF {"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:00.859731 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:00.860489 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lazy-loading 'pci_devices' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:00.891951 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.004771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:01.005007 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:01.127346 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:01.139737 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:01.187027 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Successfully updated port: eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:01.330211 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:01.363826 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <uuid>f35e1e76-19d7-4055-920e-ec4242cd9619</uuid>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <name>instance-00000003</name>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1807434522</nova:name>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:00</nova:creationTime>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:user uuid="05518f5e677e49a5ba493f2452458bda">tempest-VolumesAssistedSnapshotsTest-346714218-project-member</nova:user>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:project uuid="c81cc9d369e54af591916abb970b9d70">tempest-VolumesAssistedSnapshotsTest-346714218</nova:project>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         <nova:port uuid="cecb70b9-1b26-46ff-857c-098779b38f4f">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="serial">f35e1e76-19d7-4055-920e-ec4242cd9619</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="uuid">f35e1e76-19d7-4055-920e-ec4242cd9619</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.config"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:57:9f:56"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <target dev="tapcecb70b9-1b"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/console.log" append="off"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:01.363826 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:01.365797 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Preparing to wait for external event network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:01.365797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:01.365797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:01.365797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:01.365797 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1807434522',display_name='tempest-VolumesAssistedSnapshotsTest-server-1807434522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesassistedsnapshotstest-server-1807434522',id=3,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIef/eDoM7VoX6DfjnmTVBcR2X6dCRXiubuNZFlwLS+Qt+bSGKljJI82J7M4sV4QKMFN0ilYv0QoiMSLywnaDVKa8OMSkAE3FeHNOhOeLTLisPkgc74z1A9uPlMzXQ3eHg==',key_name='tempest-keypair-516633706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c81cc9d369e54af591916abb970b9d70',ramdisk_id='',reservation_id='r-19pj15vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-346714218',owner_user_name='tempest-VolumesAssistedSnapshotsTest-346714218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05518f5e677e49a5ba493f2452458bda',uuid=f35e1e76-19d7-4055-920e-ec4242cd9619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:01.366015 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converting VIF {"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:01.366272 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:01.366532 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:01.366914 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.367108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:01.367416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:01.368494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.368646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cda1732b-107c-5045-b372-6278ec5cbc41', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:01.369864 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.370672 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:01.371699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.374117 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.374265 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcecb70b9-1b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:01.374610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcecb70b9-1b, col_values=(('qos', UUID('713483cc-c53c-4a71-ba36-a148b5e79ed1')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:01.374934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcecb70b9-1b, col_values=(('external_ids', {'iface-id': 'cecb70b9-1b26-46ff-857c-098779b38f4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:9f:56', 'vm-uuid': 'f35e1e76-19d7-4055-920e-ec4242cd9619'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:01.375794 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.377169 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:01.383952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:01.384388 np0000000669 nova-compute[97951]: INFO os_vif [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b')
May 13 04:12:01.508212 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:01.595307 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-changed-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:01.596360 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Refreshing instance network info cache due to event network-changed-eb924cda-7564-4072-a0b5-7cdd2199896e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:01.596360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] Acquiring lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:01.596360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] Acquired lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:01.596640 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Refreshing network info cache for port eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:01.689046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:01.773228 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:01.902533 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updated VIF entry in instance network info cache for port cecb70b9-1b26-46ff-857c-098779b38f4f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:01.902759 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updating instance_info_cache with network_info: [{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:02.016441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.419s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:02.017227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.850s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:02.017398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:02.021631 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:12:02.021789 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Claim successful on node np0000000669
May 13 04:12:02.098175 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:02.135683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:02.136645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:02.136890 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Creating image(s)
May 13 04:12:02.137591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:02.137745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:02.138345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:02.138583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:02.138902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:02.174727 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:02.377978 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:02.405470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5722f062-26bb-48e9-bd66-1227e9394a3e req-b05250fc-b0af-4163-b6e7-ee6829519d1a service nova] Releasing lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:02.529549 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:02.529694 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:02.529917 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:02.530197 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:02.665572 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9ed67d1e9a41fcb16cffa5bf1455d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad8d1e0dd3a4863abd238a6abea29d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:02.881593 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d90d55d-8143-4e57-bc49-db9c4ff995db req-6a9f0e39-bfb7-42e4-a5b3-3f8cf1e588c4 service nova] Releasing lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:02.882707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquired lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:02.885103 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:02.903262 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:02.903433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:02.903581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] No VIF found with MAC fa:16:3e:57:9f:56, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:02.904095 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Using config drive
May 13 04:12:03.037575 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:03.052940 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:03.053552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:03.053725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:03.053903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:03.054062 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] No event matching network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f in dict_keys([('network-vif-plugged', '455a1a1b-3a1c-4b13-b24d-e88a7707574f')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:03.054224 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7c74bc01-78f9-4f19-b9c6-2427d1f6adc2 req-647f8082-dfc1-46ce-a58c-f4d8a78f186f service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received unexpected event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f for instance with vm_state building and task_state spawning.
May 13 04:12:03.064741 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.069085 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.069749 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.146601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.part --force-share --output=json" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.146910 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] e29f3ffa-abe5-4849-83e7-e51da14857ad was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:12:03.147493 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:12:03.147743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.part /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.335803 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.part /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.converted" returned: 0 in 0.187s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.341164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.411863 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:03.414466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0.converted --force-share --output=json" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.415018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.276s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:03.416164 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.419486 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.422225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.489302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.489743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:03.490622 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:03.491938 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.500213 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:03.501981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.539897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:03.540139 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:03.544272 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:03.563724 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:03.577933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.578281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0,backing_fmt=raw /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.611468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0,backing_fmt=raw /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk 1073741824" returned: 0 in 0.033s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.612008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "5c274da97e0497302a2af6a9cdb63d9f6c5cbde0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.121s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:03.612485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.641386 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Successfully created port: 6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:03.680254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c274da97e0497302a2af6a9cdb63d9f6c5cbde0 --force-share --output=json" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.682454 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:03.682454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:03.703934 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:03.742238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json" returned: 0 in 0.061s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:03.742593 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Cannot resize image /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:03.742926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:03.743079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Ensure instance console log exists: /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:03.743337 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:03.743610 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:03.743780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:03.952443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:04.046705 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:04.184430 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Successfully updated port: 6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:04.215141 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Creating config drive at /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.config
May 13 04:12:04.219928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgsqahn1e {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.257394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgsqahn1e" returned: 0 in 0.037s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.281648 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:04.310269 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:04.438762 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating instance_info_cache with network_info: [{"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:04.560885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.544s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:04.561445 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:04.565659 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:04.567178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.221s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:04.568100 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:04.568279 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Creating image(s)
May 13 04:12:04.568825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:04.569015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:04.569490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:04.570076 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:04.573588 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:04.575961 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:12:04.576056 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Claim successful on node np0000000669
May 13 04:12:04.580015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.652303 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.072s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.652717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:04.653595 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:04.655337 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:04.657666 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:04.658057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.687664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:04.687792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:04.687960 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:04.691599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:04.712373 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:04.740479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.740880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.778702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk 1073741824" returned: 0 in 0.037s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.780446 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.127s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:04.780762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.818113 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:04.855878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.859520 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:04.859520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:04.936602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:04.937249 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Cannot resize image /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:04.937638 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:04.937843 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Ensure instance console log exists: /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:04.938107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:04.938345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:04.938492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:04.942120 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Releasing lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:04.942170 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance network_info: |[{"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:04.944958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Start _get_guest_xml network_info=[{"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:11:40Z,direct_url=<?>,disk_format='qcow2',id=e29f3ffa-abe5-4849-83e7-e51da14857ad,min_disk=0,min_ram=0,name='',owner='c1ba8aa82f0f4388a579ae4ee9adbbec',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:11:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'e29f3ffa-abe5-4849-83e7-e51da14857ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:04.947831 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:04.949143 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='e29f3ffa-abe5-4849-83e7-e51da14857ad', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-210853464', uuid='545a546a-81c6-4bd1-ad8a-95e1afa15a0b'), owner=OwnerMeta(userid='f4620f9393254d1c9e0db0ff59cbedf9', username='tempest-AttachSCSIVolumeTestJSON-134677350-project-member', projectid='85ee7976e72845ffbdd292d619a145af', projectname='tempest-AttachSCSIVolumeTestJSON-134677350'), image=ImageMeta(id='e29f3ffa-abe5-4849-83e7-e51da14857ad', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645524.9487956) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:04.953293 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:04.953807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:04.954667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:04.954884 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:04.955987 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:04.956272 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:11:40Z,direct_url=<?>,disk_format='qcow2',id=e29f3ffa-abe5-4849-83e7-e51da14857ad,min_disk=0,min_ram=0,name='',owner='c1ba8aa82f0f4388a579ae4ee9adbbec',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:11:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:04.956425 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:04.956512 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:04.956794 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:04.956794 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:04.957229 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:04.957229 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:04.957375 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:04.957536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:04.957685 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:04.957821 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:04.981011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-210853464',display_name='tempest-AttachSCSIVolumeTestJSON-server-210853464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachscsivolumetestjson-server-210853464',id=4,image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjh20ogeKi1Fb9M9yal8T8+aD5X6BRJMtuJl8V4Ks8qe+CDjfcuzg7BknJHTCI3CYxZvBZ2wmGBBPax9sLBkCTCtNRcMm9k081JsAxgbS85sOb/OTtTjm4LU5MlVqtiyg==',key_name='tempest-keypair-348629795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ee7976e72845ffbdd292d619a145af',ramdisk_id='',reservation_id='r-wffhjrud',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-134677350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-134677350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4620f9393254d1c9e0db0ff59cbedf9',uuid=545a546a-81c6-4bd1-ad8a-95e1afa15a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:04.981193 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converting VIF {"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:04.981998 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:04.982592 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lazy-loading 'pci_devices' on Instance uuid 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:05.028150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.029623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.034002 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.036630 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.051547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.072461 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:05.072461 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:05.072461 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:05.072461 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:05.133503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:05.133784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:05.134351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:05.134490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:05.134654 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Processing event network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:05.134850 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:05.135008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:05.135462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:05.135462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:05.135637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] No waiting events found dispatching network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:05.136474 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:05.137266 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received unexpected event network-vif-plugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f for instance with vm_state building and task_state spawning.
May 13 04:12:05.137385 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-changed-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:05.137538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing instance network info cache due to event network-changed-6047b063-3e9b-46ea-b833-f8ffb140c6a8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:05.137681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:05.140761 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645525.1402955, 8d2f3521-15f2-4140-9561-7798bbe03f60 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:05.142142 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:05.143851 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] VM Resumed (Lifecycle Event)
May 13 04:12:05.148664 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Instance spawned successfully.
May 13 04:12:05.149026 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:05.167914 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd10cee2fb02f418e9835f647d34de253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed385cda159c488d94beac05f00c9ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:05.297309 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:05.487780 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <uuid>545a546a-81c6-4bd1-ad8a-95e1afa15a0b</uuid>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <name>instance-00000004</name>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-210853464</nova:name>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:04</nova:creationTime>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:image uuid="e29f3ffa-abe5-4849-83e7-e51da14857ad">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:user uuid="f4620f9393254d1c9e0db0ff59cbedf9">tempest-AttachSCSIVolumeTestJSON-134677350-project-member</nova:user>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:project uuid="85ee7976e72845ffbdd292d619a145af">tempest-AttachSCSIVolumeTestJSON-134677350</nova:project>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="e29f3ffa-abe5-4849-83e7-e51da14857ad"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         <nova:port uuid="eb924cda-7564-4072-a0b5-7cdd2199896e">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="serial">545a546a-81c6-4bd1-ad8a-95e1afa15a0b</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="uuid">545a546a-81c6-4bd1-ad8a-95e1afa15a0b</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <target dev="sda" bus="scsi"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <address type="drive" controller="0" unit="0"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.config"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <target dev="sdb" bus="scsi"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <address type="drive" controller="0" unit="1"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:35:0a:21"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <target dev="tapeb924cda-75"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/console.log" append="off"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:05.487780 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:05.487780 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Preparing to wait for external event network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:05.487780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:05.487780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:05.490272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:05.490272 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-210853464',display_name='tempest-AttachSCSIVolumeTestJSON-server-210853464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachscsivolumetestjson-server-210853464',id=4,image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjh20ogeKi1Fb9M9yal8T8+aD5X6BRJMtuJl8V4Ks8qe+CDjfcuzg7BknJHTCI3CYxZvBZ2wmGBBPax9sLBkCTCtNRcMm9k081JsAxgbS85sOb/OTtTjm4LU5MlVqtiyg==',key_name='tempest-keypair-348629795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ee7976e72845ffbdd292d619a145af',ramdisk_id='',reservation_id='r-wffhjrud',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-134677350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-134677350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4620f9393254d1c9e0db0ff59cbedf9',uuid=545a546a-81c6-4bd1-ad8a-95e1afa15a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:05.490272 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converting VIF {"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.490493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e478603d-8775-55a8-9882-18cb69ca8951', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:05.493707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.493707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:05.493707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.494882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.495050 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb924cda-75, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:05.495294 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb924cda-75, col_values=(('qos', UUID('a191a743-cfdd-40a5-81c5-8d426642f916')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:05.495423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb924cda-75, col_values=(('external_ids', {'iface-id': 'eb924cda-7564-4072-a0b5-7cdd2199896e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0a:21', 'vm-uuid': '545a546a-81c6-4bd1-ad8a-95e1afa15a0b'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:05.496201 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.499932 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:05.504639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:05.506258 np0000000669 nova-compute[97951]: INFO os_vif [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75')
May 13 04:12:05.575421 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:05.647129 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:05.648973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:05.660418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:06.051915 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:06.052293 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:06.078611 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:06.151457 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:06.151752 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645526.1515377, f35e1e76-19d7-4055-920e-ec4242cd9619 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:06.151898 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] VM Started (Lifecycle Event)
May 13 04:12:06.167845 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Took 15.22 seconds to spawn the instance on the hypervisor.
May 13 04:12:06.168427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:06.190043 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Successfully created port: 8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:06.554751 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:06.654388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:06.656053 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645526.6558478, f35e1e76-19d7-4055-920e-ec4242cd9619 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:06.656154 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] VM Paused (Lifecycle Event)
May 13 04:12:06.680303 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Took 20.47 seconds to build instance.
May 13 04:12:06.737935 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:06.877348 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Successfully updated port: 8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:06.984404 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:07.029912 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No BDM found with device name sda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:07.029912 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:07.029912 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No VIF found with MAC fa:16:3e:35:0a:21, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:07.030210 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Using config drive
May 13 04:12:07.063131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.495s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:07.063131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:07.090220 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:07.091915 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:07.092643 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Creating image(s)
May 13 04:12:07.093312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:07.093312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:07.096097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:07.097031 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:07.104022 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:07.106288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.159855 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:07.169192 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:07.181996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b8c0c56d-c9c9-4224-8ee0-9f8550b63ea9 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.974s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:07.185630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.079s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.186303 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:07.188901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:07.189411 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:07.193847 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:07.194728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.236971 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-changed-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:07.237212 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Refreshing instance network info cache due to event network-changed-8015fd9c-c636-4335-a881-63aef7924875. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:07.237849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] Acquiring lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:07.237988 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] Acquired lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:07.238164 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Refreshing network info cache for port 8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:07.270345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.270345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.285466 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:07.304204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk 1073741824" returned: 0 in 0.036s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.304644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:07.305035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.379287 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:07.392661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.393087 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:07.393410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.471425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.471995 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Cannot resize image /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:07.473073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:07.475021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Ensure instance console log exists: /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:07.475430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:07.475739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:07.475940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:07.539923 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:07.569505 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:07.572429 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:07.574555 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:07.574555 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:07.668298 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd10cee2fb02f418e9835f647d34de253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed385cda159c488d94beac05f00c9ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:07.673386 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:07.692209 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Creating config drive at /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.config
May 13 04:12:07.697179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo7sy7ngw {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:07.728032 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo7sy7ngw" returned: 0 in 0.030s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:07.741740 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:07.789115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:07.789264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Instance network_info: |[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:07.791431 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Start _get_guest_xml network_info=[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:07.791838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:07.791977 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing network info cache for port 6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:07.796256 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:07.798036 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-196565620', uuid='57380f3d-d29c-4861-9806-11a9845b9f6f'), owner=OwnerMeta(userid='9a9ed67d1e9a41fcb16cffa5bf1455d7', username='tempest-TaggedAttachmentsTest-1597568841-project-member', projectid='6ad8d1e0dd3a4863abd238a6abea29d2', projectname='tempest-TaggedAttachmentsTest-1597568841'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645527.7975705) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:07.799151 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:07.799584 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:07.800406 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:07.800645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:07.802141 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:07.802613 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:07.802844 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:07.802981 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:07.803251 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:07.803311 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:07.803516 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:07.803778 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:07.803942 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:07.804110 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:07.804271 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:07.804492 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:07.824615 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:07.825736 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:07.826100 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:07.827193 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'pci_devices' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:07.895008 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.075550 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:08.099439 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:08.246376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.270835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.294748 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <uuid>57380f3d-d29c-4861-9806-11a9845b9f6f</uuid>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <name>instance-00000005</name>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:07</nova:creationTime>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="serial">57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="uuid">57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:ee:7b:c2"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <target dev="tap6047b063-3e"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log" append="off"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:08.335243 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Preparing to wait for external event network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:08.335243 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:08.337463 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:08.337463 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:08.337463 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:08.337643 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:08.337643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.337643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:08.337643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:08.340538 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.340788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '141c8414-988b-5c12-bb44-35d8903a451a', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:08.343461 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.344361 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:08.353478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.353478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6047b063-3e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:08.353712 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6047b063-3e, col_values=(('qos', UUID('1a4278ca-fd82-4be4-89ba-61adb7a9a214')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:08.353862 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6047b063-3e, col_values=(('external_ids', {'iface-id': '6047b063-3e9b-46ea-b833-f8ffb140c6a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:7b:c2', 'vm-uuid': '57380f3d-d29c-4861-9806-11a9845b9f6f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:08.355130 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.356634 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:08.365315 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.366600 np0000000669 nova-compute[97951]: INFO os_vif [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e')
May 13 04:12:08.372833 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Successfully created port: fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:08.379901 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.579519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:08.608592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.617764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.638183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.642594 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:08.844915 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:09.159057 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:09.159057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:09.159057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:09.159057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:09.159057 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] No event matching network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f in dict_keys([('network-vif-plugged', 'cecb70b9-1b26-46ff-857c-098779b38f4f')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:09.159630 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b0df06e9-9121-4d8c-b11c-ff4204308329 req-8a9c9642-dc7a-4f79-a708-4a1e040a18ed service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received unexpected event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f for instance with vm_state building and task_state spawning.
May 13 04:12:09.276716 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645529.276171, 545a546a-81c6-4bd1-ad8a-95e1afa15a0b => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:09.276862 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] VM Started (Lifecycle Event)
May 13 04:12:09.294964 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:09.349392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03f40030-c204-493a-81a1-c84722d157cf req-f6f08088-8e48-4f63-88a0-117545d0f5fd service nova] Releasing lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:09.350136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquired lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:09.350206 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:09.391236 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:09.500089 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Successfully updated port: fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:09.595836 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:09.596695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:09.596904 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Creating image(s)
May 13 04:12:09.597289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:09.600924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:09.601459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:09.602058 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:09.606741 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:09.608153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:09.692482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:09.692904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:09.693405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:09.694094 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:09.697530 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:09.698481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:09.734652 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updated VIF entry in instance network info cache for port 6047b063-3e9b-46ea-b833-f8ffb140c6a8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:09.735349 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:09.766312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:09.769345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:09.782662 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:09.787043 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645529.7866812, 545a546a-81c6-4bd1-ad8a-95e1afa15a0b => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:09.787221 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] VM Paused (Lifecycle Event)
May 13 04:12:09.813488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk 1073741824" returned: 0 in 0.046s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:09.814013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.121s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:09.814735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:09.890020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:09.893487 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:09.893487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:09.911122 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:09.911375 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing instance network info cache due to event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:09.913513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] Acquiring lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:09.914345 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:09.914683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] Acquired lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:09.915313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:09.915800 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:09.916589 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No VIF found with MAC fa:16:3e:ee:7b:c2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:09.919267 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Using config drive
May 13 04:12:09.959187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Cannot resize image /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Ensure instance console log exists: /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:09.960599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:10.009229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:10.009401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquired lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:10.009570 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:10.070801 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:10.242401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df79ac29-05a4-4ee0-8769-3f70007c82a4 req-4e5bc57a-32dd-483b-b444-b95386436863 service nova] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:10.242401 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:10.293522 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:10.298454 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:10.423217 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:10.431969 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:10.451534 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updating instance_info_cache with network_info: [{"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:10.629145 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Creating config drive at /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config
May 13 04:12:10.632974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzujt3n_v {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:10.646491 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:10.677057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzujt3n_v" returned: 0 in 0.044s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:10.800974 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:10.930452 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:10.944961 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:10.954207 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Releasing lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:10.954602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance network_info: |[{"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:10.956789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Start _get_guest_xml network_info=[{"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:10.959119 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:10.960720 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-2098486800-1', uuid='6954b4b1-9bab-4c57-87fa-0dca61e5daf8'), owner=OwnerMeta(userid='d10cee2fb02f418e9835f647d34de253', username='tempest-TestMultiAttachVolumeSwap-540647060-project-member', projectid='ed385cda159c488d94beac05f00c9ebf', projectname='tempest-TestMultiAttachVolumeSwap-540647060'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645530.9602976) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:10.961565 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:10.961992 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:10.962627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:10.962832 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:10.963878 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:10.964252 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:10.964461 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:10.964576 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:10.964734 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:10.964851 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:10.964977 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:10.965147 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:10.965279 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:10.965435 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:10.965570 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:10.965744 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:10.984314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-1',id=6,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=6954b4b1-9bab-4c57-87fa-0dca61e5daf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:10.984314 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:10.984314 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:10.985634 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'pci_devices' on Instance uuid 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:11.202661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.221659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.226086 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.255056 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating instance_info_cache with network_info: [{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:11.264570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.264854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] No event matching network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e in dict_keys([('network-vif-plugged', 'eb924cda-7564-4072-a0b5-7cdd2199896e')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received unexpected event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e for instance with vm_state building and task_state spawning.
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No event matching network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 in dict_keys([('network-vif-plugged', '6047b063-3e9b-46ea-b833-f8ffb140c6a8')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 for instance with vm_state building and task_state spawning.
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.268814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing instance network info cache due to event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:11.271017 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updated VIF entry in instance network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:11.271411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquiring lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:11.271591 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:11.343578 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.487971 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <uuid>6954b4b1-9bab-4c57-87fa-0dca61e5daf8</uuid>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <name>instance-00000006</name>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-2098486800-1</nova:name>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:10</nova:creationTime>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:user uuid="d10cee2fb02f418e9835f647d34de253">tempest-TestMultiAttachVolumeSwap-540647060-project-member</nova:user>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:project uuid="ed385cda159c488d94beac05f00c9ebf">tempest-TestMultiAttachVolumeSwap-540647060</nova:project>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         <nova:port uuid="8015fd9c-c636-4335-a881-63aef7924875">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="serial">6954b4b1-9bab-4c57-87fa-0dca61e5daf8</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="uuid">6954b4b1-9bab-4c57-87fa-0dca61e5daf8</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.config"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:89:a6:b0"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <target dev="tap8015fd9c-c6"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/console.log" append="off"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:11.487971 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:11.489989 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Preparing to wait for external event network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:11.489989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.489989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.489989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.489989 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-1',id=6,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=6954b4b1-9bab-4c57-87fa-0dca61e5daf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:11.490211 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:11.491206 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:11.491206 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:11.491576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.491618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:11.491833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:11.493343 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.493683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb90df4a-d67a-51d4-9857-5ed2030f9b94', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:11.495346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.495346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:11.496164 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.501708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.501708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8015fd9c-c6, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:11.501708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8015fd9c-c6, col_values=(('qos', UUID('efdbe556-407d-49ad-b7ec-a675876946b5')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:11.501708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8015fd9c-c6, col_values=(('external_ids', {'iface-id': '8015fd9c-c636-4335-a881-63aef7924875', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:a6:b0', 'vm-uuid': '6954b4b1-9bab-4c57-87fa-0dca61e5daf8'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:11.507357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.507357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:11.512370 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.514876 np0000000669 nova-compute[97951]: INFO os_vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6')
May 13 04:12:11.519822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.526456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.533437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.552878 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.561135 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:11.759766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Releasing lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:11.760066 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Instance network_info: |[{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:11.762616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Start _get_guest_xml network_info=[{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:11.763139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquired lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:11.763339 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:11.767058 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:11.768336 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-2098486800-2', uuid='30a3c85b-773d-4859-b01e-a751646ff4b1'), owner=OwnerMeta(userid='d10cee2fb02f418e9835f647d34de253', username='tempest-TestMultiAttachVolumeSwap-540647060-project-member', projectid='ed385cda159c488d94beac05f00c9ebf', projectname='tempest-TestMultiAttachVolumeSwap-540647060'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645531.7679267) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:11.769558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:11.769906 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:11.770862 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:11.771019 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:11.771769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:11.772116 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:11.772240 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:11.772403 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:11.772581 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:11.772725 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:11.772909 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:11.773087 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:11.773238 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:11.773900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d24ed9-1255-4f8e-a283-441e6f6d2a14 req-3236ad22-16ea-4e7e-b7c7-3da473b49f27 service nova] Releasing lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:11.774390 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:11.774623 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:11.774809 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:11.793995 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-2',id=7,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=30a3c85b-773d-4859-b01e-a751646ff4b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:11.794455 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:11.795082 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:11.795555 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'pci_devices' on Instance uuid 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:11.992381 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.992621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.992780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.992881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.993003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] No event matching network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 in dict_keys([('network-vif-plugged', 'a937a9d4-108b-43af-977e-16b3c9f0d378')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:11.993109 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received unexpected event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 for instance with vm_state building and task_state spawning.
May 13 04:12:11.993229 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.993386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.995023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.995209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.995495 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Processing event network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:11.995690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:11.995813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:11.995963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:11.996058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:11.996916 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:11.997444 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] No waiting events found dispatching network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:11.997970 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3a63cc41-49b6-4ebc-839e-4aad2fafb66d req-c69b7c5c-a46a-4b22-ac0d-54a67065da60 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received unexpected event network-vif-plugged-a937a9d4-108b-43af-977e-16b3c9f0d378 for instance with vm_state building and task_state spawning.
May 13 04:12:11.999427 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:12.000503 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645532.0001333, 2a54ab5b-821c-46cc-80bb-49baec8f1a36 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:12.002728 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] VM Resumed (Lifecycle Event)
May 13 04:12:12.004144 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Instance spawned successfully.
May 13 04:12:12.004555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:12.054924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:12.055157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:12.266135 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:12.299348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <uuid>30a3c85b-773d-4859-b01e-a751646ff4b1</uuid>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <name>instance-00000007</name>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-2098486800-2</nova:name>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:11</nova:creationTime>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:user uuid="d10cee2fb02f418e9835f647d34de253">tempest-TestMultiAttachVolumeSwap-540647060-project-member</nova:user>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:project uuid="ed385cda159c488d94beac05f00c9ebf">tempest-TestMultiAttachVolumeSwap-540647060</nova:project>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         <nova:port uuid="fd7dcb9c-3d7f-408a-a55f-fec1a2de0135">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="serial">30a3c85b-773d-4859-b01e-a751646ff4b1</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="uuid">30a3c85b-773d-4859-b01e-a751646ff4b1</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.config"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a2:4f:44"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <target dev="tapfd7dcb9c-3d"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/console.log" append="off"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:12.299348 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:12.299348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Preparing to wait for external event network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:12.299348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:12.304194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:12.304194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:12.304194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-2',id=7,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=30a3c85b-773d-4859-b01e-a751646ff4b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.304420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '869914a8-1a8c-5caa-b5cb-2ff1743e8efa', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:12.305351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.307383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:12.312275 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.319599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.319812 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd7dcb9c-3d, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:12.320143 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd7dcb9c-3d, col_values=(('qos', UUID('535990ee-d43e-4ec5-882f-bee94dcbc4e9')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:12.320370 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd7dcb9c-3d, col_values=(('external_ids', {'iface-id': 'fd7dcb9c-3d7f-408a-a55f-fec1a2de0135', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:4f:44', 'vm-uuid': '30a3c85b-773d-4859-b01e-a751646ff4b1'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:12.327653 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:12.343507 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:12.344268 np0000000669 nova-compute[97951]: INFO os_vif [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d')
May 13 04:12:12.509212 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:12.512687 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.512830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.513195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.513481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.514436 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:12.516407 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.516407 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:12.560274 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:12:12.601535 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:12.750534 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updated VIF entry in instance network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:12.750816 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating instance_info_cache with network_info: [{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:13.019288 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:13.019532 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645533.0193841, 57380f3d-d29c-4861-9806-11a9845b9f6f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:13.019668 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] VM Started (Lifecycle Event)
May 13 04:12:13.021502 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Took 30.56 seconds to spawn the instance on the hypervisor.
May 13 04:12:13.021685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:13.042019 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:13.043793 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:13.043793 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No VIF found with MAC fa:16:3e:89:a6:b0, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:13.043793 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Using config drive
May 13 04:12:13.122120 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:13.122400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:13.128023 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:12:13.128196 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Claim successful on node np0000000669
May 13 04:12:13.190380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:13.252900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Releasing lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:13.253150 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:13.253524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:13.253524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:13.253792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:13.253792 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Processing event network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:13.254008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:13.254097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:13.254530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:13.255158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:13.255608 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:13.255708 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] No waiting events found dispatching network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:13.255828 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-94cc7bd4-25b3-4230-a0ec-71c25b36edfa req-315d6c71-afd2-4087-9b33-b46ec685393d service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received unexpected event network-vif-plugged-cecb70b9-1b26-46ff-857c-098779b38f4f for instance with vm_state building and task_state spawning.
May 13 04:12:13.258223 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:13.260860 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Instance spawned successfully.
May 13 04:12:13.261171 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:13.522778 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:13.525283 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645533.5250137, 57380f3d-d29c-4861-9806-11a9845b9f6f => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:13.525426 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] VM Paused (Lifecycle Event)
May 13 04:12:13.536063 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Took 35.81 seconds to build instance.
May 13 04:12:13.548534 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:13.694668 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Creating config drive at /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.config
May 13 04:12:13.699040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsl3a2qa {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:13.739469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsl3a2qa" returned: 0 in 0.040s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:13.775252 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.776608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.777031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.777380 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.777758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.782344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:13.863857 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:13.865965 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:13.866182 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No VIF found with MAC fa:16:3e:a2:4f:44, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:13.867069 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Using config drive
May 13 04:12:14.029210 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:14.031186 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:14.037843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-37a40bf5-cbd6-443b-8947-385f722b2122 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.318s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:14.070942 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:14.071514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:14.073664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:14.073797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:14.073994 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] No event matching network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 in dict_keys([('network-vif-plugged', '8015fd9c-c636-4335-a881-63aef7924875')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:12:14.074539 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3f4ec19c-1c49-4609-a972-fea4d37a9eb7 req-c4e6caed-00ed-409e-a849-ed6c9463e168 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received unexpected event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 for instance with vm_state building and task_state spawning.
May 13 04:12:14.247793 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.277935 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.290704 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Took 14.71 seconds to spawn the instance on the hypervisor.
May 13 04:12:14.291542 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:14.297269 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.378444 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:14.406376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.533771 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:14.533771 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645534.5335708, f35e1e76-19d7-4055-920e-ec4242cd9619 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:14.534514 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] VM Resumed (Lifecycle Event)
May 13 04:12:14.600898 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Creating config drive at /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.config
May 13 04:12:14.606468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuneq6s2o {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:14.640642 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.644370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuneq6s2o" returned: 0 in 0.038s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:14.647101 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.653519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.666073 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.669844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:14.731028 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:14.731337 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:14.815531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Took 20.14 seconds to build instance.
May 13 04:12:15.040457 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:15.043339 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:15.153958 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.175564 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.178290 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.236874 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:15.288897 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.314928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.316016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:15.317156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-db726505-c54b-4d2f-9ff3-eebad6907254 tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.660s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:15.545670 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645535.5453167, 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:15.546093 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] VM Started (Lifecycle Event)
May 13 04:12:15.744907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.622s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:15.745498 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:16.037439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:16.048985 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:16.052847 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645536.0524592, 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:16.053987 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] VM Paused (Lifecycle Event)
May 13 04:12:16.065847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:16.068215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:16.164370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:16.165661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Processing event network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:16.167124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] No waiting events found dispatching network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:16.167676 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b26a28b0-bac5-47bf-8a90-452069023c8f req-9cb44d70-2b74-4615-a17d-769a3c43b4af service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received unexpected event network-vif-plugged-8015fd9c-c636-4335-a881-63aef7924875 for instance with vm_state building and task_state spawning.
May 13 04:12:16.174160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:16.176528 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance spawned successfully.
May 13 04:12:16.177576 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:16.253619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:16.256708 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:16.256708 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:16.256708 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:16.380978 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f4d2a3b569e43219b9d28dfb3990758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f6190e477e45ffb44a9f7754ab6965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:16.450408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-46978ce0-a212-4591-af09-00a50125cd91 req-4ab95207-ed47-416c-aaed-ef06d6a45f0f service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:16.450867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-46978ce0-a212-4591-af09-00a50125cd91 req-4ab95207-ed47-416c-aaed-ef06d6a45f0f service nova] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:16.451011 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-46978ce0-a212-4591-af09-00a50125cd91 req-4ab95207-ed47-416c-aaed-ef06d6a45f0f service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:16.451130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-46978ce0-a212-4591-af09-00a50125cd91 req-4ab95207-ed47-416c-aaed-ef06d6a45f0f service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:16.451266 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-46978ce0-a212-4591-af09-00a50125cd91 req-4ab95207-ed47-416c-aaed-ef06d6a45f0f service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Processing event network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:16.453042 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:16.460830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:16.463147 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Instance spawned successfully.
May 13 04:12:16.463544 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:16.559451 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:16.564400 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645536.562752, 30a3c85b-773d-4859-b01e-a751646ff4b1 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:16.564400 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] VM Started (Lifecycle Event)
May 13 04:12:16.573869 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lazy-loading 'flavor' on Instance uuid 2a54ab5b-821c-46cc-80bb-49baec8f1a36 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:16.682761 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.682892 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.683160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.683411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.683679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.683914 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.759311 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:16.979674 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.979674 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.979914 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.980163 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.980552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:16.980734 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:17.069882 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:17.072192 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:17.115123 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Successfully created port: c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:17.193622 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Took 10.10 seconds to spawn the instance on the hypervisor.
May 13 04:12:17.195291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:17.262406 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:17.322382 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:17.485549 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Took 7.89 seconds to spawn the instance on the hypervisor.
May 13 04:12:17.485549 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:17.576133 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:17.576133 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645537.574987, 30a3c85b-773d-4859-b01e-a751646ff4b1 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:17.576133 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] VM Paused (Lifecycle Event)
May 13 04:12:17.587527 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:17.707311 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Took 19.63 seconds to build instance.
May 13 04:12:17.775408 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Successfully updated port: c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:17.852031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-changed-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:17.852543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Refreshing instance network info cache due to event network-changed-c0bec8c6-18c9-46f2-87ef-63d20e48e115. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:17.852752 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] Acquiring lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:17.852883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] Acquired lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:17.853001 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Refreshing network info cache for port c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:17.999463 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Took 19.71 seconds to build instance.
May 13 04:12:18.080978 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:18.082391 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645538.082131, 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:18.082564 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] VM Resumed (Lifecycle Event)
May 13 04:12:18.208862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.137s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.260487 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-changed-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:18.260746 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Refreshing instance network info cache due to event network-changed-cecb70b9-1b26-46ff-857c-098779b38f4f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:18.260958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] Acquiring lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:18.261069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] Acquired lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:18.262974 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Refreshing network info cache for port cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:18.273215 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:18.275604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:18.275868 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Creating image(s)
May 13 04:12:18.276412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:18.277344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:18.277344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:18.279869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.280614 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:18.285380 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:18.287204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:18.355941 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:18.393246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:18.394212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:18.395459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:18.397364 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:18.404211 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:18.404211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:18.455509 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:18.499487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:18.500006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:18.517351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.237s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.540134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk 1073741824" returned: 0 in 0.040s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:18.540689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.541093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:18.590004 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:18.592876 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:18.633426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:18.633897 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:18.635360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:18.655919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:18.656779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:18.658018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:18.658018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.658018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] No waiting events found dispatching network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:18.658018 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-37c071af-55ab-469d-a487-668eb260adeb req-4ae66f13-7859-45cb-8e5c-bdb4bd5c2b50 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received unexpected event network-vif-plugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 for instance with vm_state active and task_state None.
May 13 04:12:18.720629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:18.724424 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:18.726422 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Cannot resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:18.726422 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:18.726422 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Ensure instance console log exists: /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:18.727119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:18.727119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:18.727119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:18.765992 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:19.106918 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645539.1051776, 30a3c85b-773d-4859-b01e-a751646ff4b1 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:19.106918 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] VM Resumed (Lifecycle Event)
May 13 04:12:19.221441 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:19.227695 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c7fb27cc-2423-472c-8b79-4ebf2392d2e4 req-5eb029c4-aee2-4b3f-8e4e-c621669e000b service nova] Releasing lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:19.228283 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquired lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:19.228530 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:19.266614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:19.267525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:19.269487 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Attaching volume f7916e47-f55e-48c1-b2dd-9e544aa08527 to /dev/vdb
May 13 04:12:19.300629 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:19.345261 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:19.345999 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.346270 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.347179 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdftlopfe/privsep.sock']
May 13 04:12:19.351401 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.352499 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.352833 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.353076 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.353901 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.353901 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:12:19.354389 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:12:19.360289 np0000000669 sudo[110486]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdftlopfe/privsep.sock
May 13 04:12:19.361122 np0000000669 sudo[110486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 04:12:19.440900 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updated VIF entry in instance network info cache for port cecb70b9-1b26-46ff-857c-098779b38f4f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:19.441221 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updating instance_info_cache with network_info: [{"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:19.608724 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:19.610973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:12:19.620206 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 04:12:19.831163 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:19.861486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:19.861941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:19.861941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:19.861941 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:12:19.945274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-59d80459-0b39-4504-88da-312f76efb863 req-09fd7fe7-a564-41cc-956e-a6b1f8680e6e service nova] Releasing lock "refresh_cache-f35e1e76-19d7-4055-920e-ec4242cd9619" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:19.979372 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 04:12:19.982630 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 04:12:19.982800 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 04:12:19.982926 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:12:19.986178 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 04:12:19.986348 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 04:12:19.986489 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 04:12:19.986614 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 04:12:19.986741 np0000000669 nova-compute[97951]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 04:12:20.021625 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:20.182780 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:20.246486 np0000000669 sudo[110486]: pam_unix(sudo:session): session closed for user root
May 13 04:12:20.247945 np0000000669 nova-compute[97951]: INFO oslo.privsep.daemon [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Spawned new privsep daemon via rootwrap
May 13 04:12:20.367902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:12:20.368306 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.nvmeof [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 13 04:12:20.394908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:20.425213 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:12:20.425789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:12:20.437194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:12:20.440746 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe08:dc42', 'fe80::a0d9:aaff:fe3f:3171', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44'] 
May 13 04:12:20.440746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:12:20.440746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:12:20.440746 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] <== get_connector_properties: return (1094ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:20.440746 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updating existing volume attachment record: 51c464dd-de6f-4110-831d-c7d0e2dccc67 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:12:20.685177 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Releasing lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:20.685704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance network_info: |[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:20.687856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start _get_guest_xml network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:20.690609 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:20.692308 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-678076492', uuid='c230a3ec-2c84-425b-b594-f0c669d01bfe'), owner=OwnerMeta(userid='3f4d2a3b569e43219b9d28dfb3990758', username='tempest-AttachVolumeTestJSON-1777051046-project-member', projectid='32f6190e477e45ffb44a9f7754ab6965', projectname='tempest-AttachVolumeTestJSON-1777051046'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645540.6918378) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:20.693688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:20.694109 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:20.694789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:20.694996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:20.696248 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:20.697168 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:20.697168 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:20.697168 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:20.697168 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:20.697453 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:20.697453 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:20.699591 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:20.699591 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:20.699591 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:20.699591 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:20.699591 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:20.721063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:20.721282 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:20.721771 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:20.722266 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'pci_devices' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:20.738969 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:20.739113 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing instance network info cache due to event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:20.739308 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] Acquiring lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:20.739463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] Acquired lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:20.739632 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:20.914295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:20.991350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:20.992452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.044197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:21.044600 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:21.047848 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connector [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Factory for ISCSI on None {{(pid=97951) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 13 04:12:21.048485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:21.048563 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:12:21.049218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:21.049698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:21.050509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:21.051167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:12:21.066497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:21.067211 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:21.068384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:21.068384 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:12:21.069336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:21.070795 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:12:21.071856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.078346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.094797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:12:21.094797 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:21.097383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:12:21.097383 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:21.116471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527] added
May 13 04:12:21.116471 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:12:21.116471 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:21.116471 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:21.116471 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:21.116471 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:21.116471 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:21.116768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:12:21.117247 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0463(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:12:21.117930 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:12:21.119071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527] added
May 13 04:12:21.119071 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:12:21.119071 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:21.119071 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:21.119071 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:21.119071 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:21.119071 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:21.119241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:12:21.119651 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0512(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:12:21.119991 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:12:21.162268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.162710 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.228203 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <uuid>c230a3ec-2c84-425b-b594-f0c669d01bfe</uuid>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <name>instance-00000008</name>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeTestJSON-server-678076492</nova:name>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:20</nova:creationTime>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:user uuid="3f4d2a3b569e43219b9d28dfb3990758">tempest-AttachVolumeTestJSON-1777051046-project-member</nova:user>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:project uuid="32f6190e477e45ffb44a9f7754ab6965">tempest-AttachVolumeTestJSON-1777051046</nova:project>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         <nova:port uuid="c0bec8c6-18c9-46f2-87ef-63d20e48e115">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="serial">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="uuid">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:35:ec:76"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <target dev="tapc0bec8c6-18"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/console.log" append="off"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:21.228203 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:21.236577 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Preparing to wait for external event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:21.236577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:21.236577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:21.236577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:21.236577 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:21.236854 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:21.238267 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:21.238267 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:21.239206 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.239206 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:21.239624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:21.241195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.241360 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfdc17cb-c158-5830-b03d-36b63cc1bb19', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:21.243483 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:21.247661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.249055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:21.254401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.254557 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.255777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0bec8c6-18, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:21.255777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0bec8c6-18, col_values=(('qos', UUID('76b46c7f-2c51-4f82-a47b-520412037f3a')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:21.255777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0bec8c6-18, col_values=(('external_ids', {'iface-id': 'c0bec8c6-18c9-46f2-87ef-63d20e48e115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ec:76', 'vm-uuid': 'c230a3ec-2c84-425b-b594-f0c669d01bfe'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:21.259926 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.262954 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.263096 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:21.274577 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:21.279481 np0000000669 nova-compute[97951]: INFO os_vif [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:12:21.352342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.355391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.448923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.453510 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.535444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.535957 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.626481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.629852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.715386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.715813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.755898 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:21.799354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.802277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.878222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.878765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:21.963446 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updated VIF entry in instance network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:21.964112 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating instance_info_cache with network_info: [{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:21.966220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:21.971662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:22.080351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:22.080351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:22.120504 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:12:22.122637 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:12:22.140550 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:12:22.140550 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:12:22.147838 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:12:22.147838 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:22.155132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:22.165282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:22.169457 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:22.169457 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:22.169457 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:22.169457 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:22.169457 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:12:22.169457 np0000000669 nova-compute[97951]: 
May 13 04:12:22.176404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:22.178437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:22.178437 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:22.178539 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:22.178539 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:22.178646 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:12:22.178646 np0000000669 nova-compute[97951]: 
May 13 04:12:22.181628 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:22.181759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:22.208636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.026s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:22.209119 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13798MB free_disk=74.74795913696289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:12:22.209297 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:22.209657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:22.315240 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9df6ac39-4d37-4a99-a8d6-30d0a4f9d07a req-246fe864-9aeb-47e3-8c75-8b7eadf358cb service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:22.315240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9df6ac39-4d37-4a99-a8d6-30d0a4f9d07a req-246fe864-9aeb-47e3-8c75-8b7eadf358cb service nova] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:22.315240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9df6ac39-4d37-4a99-a8d6-30d0a4f9d07a req-246fe864-9aeb-47e3-8c75-8b7eadf358cb service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:22.315493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9df6ac39-4d37-4a99-a8d6-30d0a4f9d07a req-246fe864-9aeb-47e3-8c75-8b7eadf358cb service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:22.315548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9df6ac39-4d37-4a99-a8d6-30d0a4f9d07a req-246fe864-9aeb-47e3-8c75-8b7eadf358cb service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Processing event network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:22.316572 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance event wait completed in 13 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:22.320560 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645542.319091, 545a546a-81c6-4bd1-ad8a-95e1afa15a0b => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:22.320974 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] VM Resumed (Lifecycle Event)
May 13 04:12:22.327491 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:22.329731 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance spawned successfully.
May 13 04:12:22.330166 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:22.333370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:22.334091 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:22.334091 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:22.335341 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:22.468428 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f62759d-148a-4a0d-94df-3440a31e68c5 req-86d54f9a-7633-44a4-a095-397cf69f8949 service nova] Releasing lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:22.808218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:22.808740 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:22.808740 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:35:ec:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:22.809092 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Using config drive
May 13 04:12:22.829970 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:22.830418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:22.842217 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Took 20.71 seconds to spawn the instance on the hypervisor.
May 13 04:12:22.843202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:23.232096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.40.100,3260]
May 13 04:12:23.232096 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.40.100,3260] successful.
May 13 04:12:23.232096 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:23.232954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.50.100,3260]
May 13 04:12:23.232954 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.50.100,3260] successful.
May 13 04:12:23.232954 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:23.246716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:23.256733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:23.263027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.263027 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.263027 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:23.263187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.263187 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.263187 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:23.263620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.196s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:23.263775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:12:23.265098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] HCTL ('8', '-', '-', 0) found on session 2 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:12:23.265098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:12:23.271158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.271158 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.271158 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:23.274354 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] HCTL ('7', '-', '-', 0) found on session 1 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:12:23.274354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:12:23.289194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Searching for a device in session 2 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:12:23.289194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:12:23.297008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Searching for a device in session 1 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:12:23.297008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:12:23.322111 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:23.326008 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2a54ab5b-821c-46cc-80bb-49baec8f1a36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326008 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326008 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f35e1e76-19d7-4055-920e-ec4242cd9619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326186 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326317 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 57380f3d-d29c-4861-9806-11a9845b9f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326758 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326758 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 30a3c85b-773d-4859-b01e-a751646ff4b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326758 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c230a3ec-2c84-425b-b594-f0c669d01bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:12:23.326972 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:12:23.327136 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:12:22 up 26 min,  2 users,  load average: 5.52, 2.68, 1.34\n', 'num_instances': '8', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_424a63b8c033439491bb333cc25998a9': '1', 'io_workload': '3', 'num_proj_03c2202127ca4ec4a872d2af2f5e4576': '1', 'num_proj_c81cc9d369e54af591916abb970b9d70': '1', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_85ee7976e72845ffbdd292d619a145af': '1', 'num_proj_6ad8d1e0dd3a4863abd238a6abea29d2': '1', 'num_proj_ed385cda159c488d94beac05f00c9ebf': '2', 'num_proj_32f6190e477e45ffb44a9f7754ab6965': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:12:23.333794 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:23.360265 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Took 28.51 seconds to build instance.
May 13 04:12:23.541879 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Creating config drive at /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config
May 13 04:12:23.545921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxu_a66xq {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:23.597425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxu_a66xq" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:23.844725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:23.845211 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:23.863976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.016s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.070833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:12:24.084350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.106966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.214953 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.301615 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.348954 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1dc88538-be5c-4c7b-b219-50bbb00ff8ba req-4c590b5e-e636-49e7-adfd-6bd2469485ac service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:24.349581 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1dc88538-be5c-4c7b-b219-50bbb00ff8ba req-4c590b5e-e636-49e7-adfd-6bd2469485ac service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:24.349811 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1dc88538-be5c-4c7b-b219-50bbb00ff8ba req-4c590b5e-e636-49e7-adfd-6bd2469485ac service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:24.349993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1dc88538-be5c-4c7b-b219-50bbb00ff8ba req-4c590b5e-e636-49e7-adfd-6bd2469485ac service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.350177 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1dc88538-be5c-4c7b-b219-50bbb00ff8ba req-4c590b5e-e636-49e7-adfd-6bd2469485ac service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Processing event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:24.352654 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:24.433509 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:24.433509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:24.433707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:24.433849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.434000 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] No waiting events found dispatching network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:24.434172 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received unexpected event network-vif-plugged-eb924cda-7564-4072-a0b5-7cdd2199896e for instance with vm_state active and task_state None.
May 13 04:12:24.437737 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:24.437737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:24.437737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:24.437737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.437737 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Processing event network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:12:24.438035 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:24.438070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:24.438218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:24.439953 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Instance event wait completed in 12 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:24.439953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.439953 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:24.439953 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b46a54c3-46d0-4f5f-82b8-59ba71f3bbfe req-a4ecb16c-1893-46be-9165-ea58c1237652 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-plugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 for instance with vm_state building and task_state spawning.
May 13 04:12:24.446291 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645544.4458084, 57380f3d-d29c-4861-9806-11a9845b9f6f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:24.447287 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] VM Resumed (Lifecycle Event)
May 13 04:12:24.449196 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:24.455279 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Instance spawned successfully.
May 13 04:12:24.455756 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:24.504940 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.508701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.533782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:24.861709 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:12:24.862082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.652s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:24.862909 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 57.73 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:12:24.952543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:24.955078 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:24.964385 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:24.964511 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:24.964823 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:24.965088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:24.965439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:24.965717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.093881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Found WWN 3300000002980d8a8 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:12:25.095418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.044s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:25.095697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] <== connect_volume: return (4045ms) {'type': 'block', 'scsi_wwn': '3300000002980d8a8', 'path': '/dev/dm-0', 'multipath_id': '3300000002980d8a8'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:25.096022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002980d8a8', 'path': '/dev/dm-0', 'multipath_id': '3300000002980d8a8'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:12:25.100175 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lazy-loading 'flavor' on Instance uuid 2a54ab5b-821c-46cc-80bb-49baec8f1a36 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:25.133854 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:12:25.137097 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:12:25.141424 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance spawned successfully.
May 13 04:12:25.141734 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:12:25.459287 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:25.459655 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645545.4593072, c230a3ec-2c84-425b-b594-f0c669d01bfe => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:25.459781 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Started (Lifecycle Event)
May 13 04:12:25.477093 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Took 20.91 seconds to spawn the instance on the hypervisor.
May 13 04:12:25.477254 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:25.603463 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Attempting to attach volume f7916e47-f55e-48c1-b2dd-9e544aa08527 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:12:25.604653 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:   <alias name="ua-f7916e47-f55e-48c1-b2dd-9e544aa08527"/>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:   <serial>f7916e47-f55e-48c1-b2dd-9e544aa08527</serial>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]: </disk>
May 13 04:12:25.604653 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:12:25.656564 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.656695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.656957 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.657243 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.657661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.657661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:12:25.962510 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:25.964303 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:25.991132 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Took 30.40 seconds to build instance.
May 13 04:12:26.161943 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Took 7.89 seconds to spawn the instance on the hypervisor.
May 13 04:12:26.162083 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:26.270081 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:26.453658 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:26.453841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:26.454059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:26.454157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:26.454284 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:26.459060 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-dedfbf5d-e12e-41f2-a012-99585f8143a2 req-3335738e-fde1-40b1-b1e7-c4de46869be3 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state active and task_state None.
May 13 04:12:26.467893 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:12:26.468607 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645546.4681845, c230a3ec-2c84-425b-b594-f0c669d01bfe => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:26.468773 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Paused (Lifecycle Event)
May 13 04:12:26.492950 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.911s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:26.537472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-changed-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:26.537602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Refreshing instance network info cache due to event network-changed-eb924cda-7564-4072-a0b5-7cdd2199896e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:26.537715 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] Acquiring lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:26.537794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] Acquired lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:26.537904 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Refreshing network info cache for port eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:26.671444 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Took 13.60 seconds to build instance.
May 13 04:12:26.973651 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:26.975479 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645546.9752083, c230a3ec-2c84-425b-b594-f0c669d01bfe => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:26.975681 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Resumed (Lifecycle Event)
May 13 04:12:27.040089 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:27.173110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e0b6d70-2199-47c7-a286-7431405db803 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.118s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:27.280526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:27.280792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:27.280848 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:12:27.281125 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] No VIF found with MAC fa:16:3e:08:dc:42, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:12:27.478204 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:27.479535 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:12:27.511696 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:27.687700 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updated VIF entry in instance network info cache for port eb924cda-7564-4072-a0b5-7cdd2199896e. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:27.688350 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating instance_info_cache with network_info: [{"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:28.191798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad684c79-5c31-4479-83f6-243f70d598e7 req-5063b6fa-3776-4a57-81e1-d5b6d367e32c service nova] Releasing lock "refresh_cache-545a546a-81c6-4bd1-ad8a-95e1afa15a0b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:28.523808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-changed-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:28.524441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Refreshing instance network info cache due to event network-changed-c0bec8c6-18c9-46f2-87ef-63d20e48e115. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:28.524441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] Acquiring lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:28.524441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] Acquired lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:28.524630 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Refreshing network info cache for port c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:28.628017 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-changed-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:28.628202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing instance network info cache due to event network-changed-6047b063-3e9b-46ea-b833-f8ffb140c6a8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:28.628608 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:28.628608 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:28.628729 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing network info cache for port 6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:28.884263 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-dcedf07a-2002-4aa1-ac18-2ad1be2b1ce6 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.617s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:29.028377 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:29.131120 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:29.304898 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:29.521526 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:29.646988 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:29.726439 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updated VIF entry in instance network info cache for port c0bec8c6-18c9-46f2-87ef-63d20e48e115. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:29.726864 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:29.830941 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updated VIF entry in instance network info cache for port 6047b063-3e9b-46ea-b833-f8ffb140c6a8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:12:29.831365 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:30.118018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:30.118217 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:30.118428 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:30.118524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:30.118612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:30.123008 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Terminating instance
May 13 04:12:30.229389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5d346c3-4710-4ae4-8025-9b73ebe777cf req-ad524bf3-ad5b-4c0c-ae0f-4fd6d17d223d service nova] Releasing lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:30.333617 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0fb9f9f3-949c-4020-a0c9-4ffc0aed8914 req-881171a7-abb0-4dec-8388-3e313d819e29 service nova] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:30.629978 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:12:30.650771 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.654062 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.673083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.679053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.705563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.707768 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:30.862310 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:30.862898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:30.865348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:30.865348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:30.865348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] No waiting events found dispatching network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:30.865348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-65827efd-0259-4ea3-9458-c682cf848059 req-18593788-3a5e-4d40-bb40-398bc9e12bb3 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:12:30.987381 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99908455800005 future=<Future at 0x7a4648210170 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:12:30.989376 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997538164999924 future=<Future at 0x7a4648210170 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:12:30.989376 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997358874999918 future=<Future at 0x7a4648210170 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:12:30.990628 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Instance destroyed successfully.
May 13 04:12:30.991425 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lazy-loading 'resources' on Instance uuid 2a54ab5b-821c-46cc-80bb-49baec8f1a36 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:31.272235 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:31.495548 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2077667566',display_name='tempest-DeleteServersTestJSON-server-2077667566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-deleteserverstestjson-server-2077667566',id=1,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424a63b8c033439491bb333cc25998a9',ramdisk_id='',reservation_id='r-uet50n95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-69299131',owner_user_name='tempest-DeleteServersTestJSON-69299131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:13Z,user_data=None,user_id='799034b9ffd74e119275abbe08f36d71',uuid=2a54ab5b-821c-46cc-80bb-49baec8f1a36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:12:31.496308 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converting VIF {"id": "a937a9d4-108b-43af-977e-16b3c9f0d378", "address": "fa:16:3e:08:dc:42", "network": {"id": "bc708685-af4a-4a4c-ba4d-496179729c82", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840778785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "424a63b8c033439491bb333cc25998a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa937a9d4-10", "ovs_interfaceid": "a937a9d4-108b-43af-977e-16b3c9f0d378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:31.496729 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:31.496729 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:12:31.499579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:31.500439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa937a9d4-10, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:31.502632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:31.504335 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:31.505030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:31.505716 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c4d29e3-3cb7-494d-827a-d3e2a3cdee08) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:31.506471 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:31.507630 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:31.510024 np0000000669 nova-compute[97951]: INFO os_vif [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:dc:42,bridge_name='br-int',has_traffic_filtering=True,id=a937a9d4-108b-43af-977e-16b3c9f0d378,network=Network(bc708685-af4a-4a4c-ba4d-496179729c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa937a9d4-10')
May 13 04:12:31.511811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:12:31.512163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:31.512334 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:31.512769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:31.513130 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7916e47-f55e-48c1-b2dd-9e544aa08527', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:12:31.513281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:12:31.539940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:31.539940 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:31.539940 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:31.540171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:31.540171 np0000000669 nova-compute[97951]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527 (non-flash)
May 13 04:12:31.540171 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:31.540423 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', '1'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', '2')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:12:31.540576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', '2')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:12:31.541853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527', '1')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:12:31.543132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648232980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:12:31.543524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:12:31.543960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Flush multipath device 3300000002980d8a8 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:12:31.583772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:12:31.623610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:12:31.668252 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:12:31.668310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:12:31.669989 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:12:31.684850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:12:31.684997 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:12:31.700572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.731951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.40.100,3260]
May 13 04:12:31.731951 np0000000669 nova-compute[97951]: Logout of [sid: 2, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.40.100,3260] successful.
May 13 04:12:31.731951 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.744675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.756153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.791061 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.50.100,3260]
May 13 04:12:31.791061 np0000000669 nova-compute[97951]: Logout of [sid: 1, target: iqn.2023-03.storpool.com:os--volume-f7916e47-f55e-48c1-b2dd-9e544aa08527, portal: 192.168.50.100,3260] successful.
May 13 04:12:31.791061 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.801979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:31.802222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:31.802370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] <== disconnect_volume: return (289ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:31.802526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:12:31.803035 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Deleting instance files /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36_del
May 13 04:12:31.803988 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Deletion of /opt/stack/data/nova/instances/2a54ab5b-821c-46cc-80bb-49baec8f1a36_del complete
May 13 04:12:32.314361 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Took 1.68 seconds to destroy the instance on the hypervisor.
May 13 04:12:32.316025 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:12:32.316534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:12:32.316670 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:12:32.316931 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:32.405893 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:32.772884 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7e4ffe4c-5692-4c70-97ab-233d09bd0a98 req-9e17f0b8-cc4e-4ae3-85c3-8b06f73c7c08 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-deleted-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:32.773265 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-7e4ffe4c-5692-4c70-97ab-233d09bd0a98 req-9e17f0b8-cc4e-4ae3-85c3-8b06f73c7c08 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Neutron deleted interface a937a9d4-108b-43af-977e-16b3c9f0d378; detaching it from the instance and deleting it from the info cache
May 13 04:12:32.773265 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7e4ffe4c-5692-4c70-97ab-233d09bd0a98 req-9e17f0b8-cc4e-4ae3-85c3-8b06f73c7c08 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:32.936867 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:32.937071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] Acquiring lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:32.940670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:32.940875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:32.941003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] No waiting events found dispatching network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:32.941190 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0efa9c50-24d1-4594-a006-9bf87a01df9d req-f6da1586-16ca-408e-80fb-f129c6ddb0a9 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Received event network-vif-unplugged-a937a9d4-108b-43af-977e-16b3c9f0d378 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:12:33.219063 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:33.276942 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7e4ffe4c-5692-4c70-97ab-233d09bd0a98 req-9e17f0b8-cc4e-4ae3-85c3-8b06f73c7c08 service nova] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Detach interface failed, port_id=a937a9d4-108b-43af-977e-16b3c9f0d378, reason: Instance 2a54ab5b-821c-46cc-80bb-49baec8f1a36 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:12:33.721388 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Took 1.40 seconds to deallocate network for instance.
May 13 04:12:34.288104 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Took 0.57 seconds to detach 1 volumes for instance.
May 13 04:12:34.309378 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:34.794839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:34.794996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:35.316079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:35.316079 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:35.821502 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:36.332056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.537s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:36.400966 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Deleted allocations for instance 2a54ab5b-821c-46cc-80bb-49baec8f1a36
May 13 04:12:36.506922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:37.411262 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a4b40110-97f7-473b-b61a-d8aa298310b3 tempest-DeleteServersTestJSON-69299131 tempest-DeleteServersTestJSON-69299131-project-member] Lock "2a54ab5b-821c-46cc-80bb-49baec8f1a36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.293s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:39.309885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:41.142022 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:41.507818 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:44.312863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:44.472968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:44.473097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:44.976825 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:12:45.551837 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:45.552184 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:45.554793 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:12:45.554967 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Claim successful on node np0000000669
May 13 04:12:45.987461 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0010356029999911698 future=<Future at 0x7a4648210170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:12:45.987651 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:12:45.988027 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778645550.9862974, 2a54ab5b-821c-46cc-80bb-49baec8f1a36 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:12:45.988146 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] VM Stopped (Lifecycle Event)
May 13 04:12:46.490908 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0ced9e8a-0368-48e8-ba10-13a783527f7e None None] [instance: 2a54ab5b-821c-46cc-80bb-49baec8f1a36] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:12:46.508806 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:46.882851 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:47.139982 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:47.140177 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:47.643271 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:48.157521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:48.157991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:48.664567 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:48.665963 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:48.666510 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:48.666872 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:48.744806 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:48.989056 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d61d62838a74be387b7339e3ae75fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9f82df01ea4b71bca6616768a403f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:49.089222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:49.090294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:49.171978 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:49.319788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:49.592526 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:12:49.740647 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully created port: 37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:50.174040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:50.174857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:50.179859 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:12:50.179859 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Claim successful on node np0000000669
May 13 04:12:50.263615 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully created port: 52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:50.688334 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:50.749563 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully created port: a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:51.203691 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Booting with volume 459369df-c0de-4c59-98d8-d3b616f7dd28 at /dev/vda
May 13 04:12:51.256952 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:51.265256 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully created port: 7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:51.278821 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:12:51.306001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:51.343066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:12:51.346657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:12:51.360564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:12:51.361543 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:12:51.361678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:12:51.361855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:12:51.363976 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:51.363976 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating existing volume attachment record: 03177762-6f79-451a-9f1a-d41815c17616 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:12:51.512110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:51.768436 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully created port: d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:51.863135 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:12:51.863538 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:12:52.369582 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:12:52.514012 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:52.515828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:52.615432 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: 37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:52.692860 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:52.693048 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-37cdbc96-1ec2-42b4-a204-e478fcc3e152. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:52.693238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:52.693391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:52.693566 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:52.878678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:52.879194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:12:53.021655 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lazy-loading 'flavor' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:53.052851 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Booting with volume 8d45a4fd-760c-4a7c-8fec-35a225ebd1ad at /dev/vdb
May 13 04:12:53.080730 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:53.125363 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:53.140545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:12:53.169711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:53.200232 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:53.210498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:12:53.214371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:12:53.226814 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:12:53.229164 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:12:53.229417 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:12:53.229575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:12:53.231123 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:53.231437 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating existing volume attachment record: 6721acf6-1b44-432a-84b0-10b248cad7d6 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:12:53.341414 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:53.389149 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:12:53.389149 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:12:53.390532 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:53.390532 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:53.726565 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cffc8fad0694442ad05ced625bbe1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c2202127ca4ec4a872d2af2f5e4576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:12:53.895383 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:12:53.949622 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: 8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:53.998806 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:54.036953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:54.095057 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:54.095228 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-8bc8529f-7284-4f43-9ec5-3f81fe1525e1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:54.097500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:54.319356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:54.399510 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:12:54.502291 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52025c91-4965-4697-8dd9-aa400cc95661 req-c85d01df-09e6-432b-96e4-84eda4ed409e service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:54.505661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:54.505819 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:54.919709 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Booting with volume 8eda2b22-e827-4553-8dfe-f381270476a8 at /dev/vdc
May 13 04:12:54.934281 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Successfully created port: e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:12:54.980141 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:54.993844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:12:55.009848 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:55.038152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.068374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:12:55.068769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:12:55.084410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:12:55.086635 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:12:55.086635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:12:55.086635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:12:55.087240 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:55.087240 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating existing volume attachment record: 348a5004-3086-4305-92f6-2c80498ad17b {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:12:55.130304 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: 15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:55.156379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:55.156735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:55.157053 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Attaching volume b817a296-21c0-40b9-b28a-0586475b9be0 to /dev/vdb
May 13 04:12:55.186387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:55.253918 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:55.269437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:12:55.299701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.332202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:12:55.335737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:12:55.353530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:12:55.355906 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:12:55.356095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:12:55.356227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:12:55.356567 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:55.356914 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updating existing volume attachment record: b6561e77-4238-4155-bf7c-695a2c0726c2 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:12:55.415727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:55.422183 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:55.425357 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating image(s)
May 13 04:12:55.427193 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:55.427407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:55.427750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:55.432337 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:55.433291 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:55.438202 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:55.440120 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.527399 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:55.530453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:55.531940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:55.531940 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:55.536375 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:12:55.536375 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.625920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:55.626639 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.674343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk 1073741824" returned: 0 in 0.047s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:55.675096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:55.675866 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.701236 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:55.779070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:55.780765 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:12:55.780765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:12:55.856444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:12:55.857250 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Cannot resize image /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:12:55.859523 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:12:55.859523 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Ensure instance console log exists: /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:55.859523 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:55.859523 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:55.859523 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:55.926936 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:55.927942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:55.928348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:55.928480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:55.928672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:12:55.928829 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d4f30fc3-ec4a-4905-9614-361753d597eb req-43b7122d-6d92-4808-9831-2534b46a02b3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state building and task_state spawning.
May 13 04:12:55.949996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:12:55.950099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:12:55.950353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:55.950834 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:55.951125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:12:55.967036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:55.967482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:55.967799 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:12:55.970610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:12:55.970686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:12:55.970969 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:12:55.987059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:12:55.987059 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:55.993003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:12:55.993003 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0] added
May 13 04:12:56.004286 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:56.004286 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:56.004286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:12:56.005774 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:12:56.005774 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:12:56.006622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0] added
May 13 04:12:56.006622 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:12:56.006622 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:56.006622 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:56.006622 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:12:56.006622 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:12:56.006622 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:56.006839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:12:56.006839 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:12:56.006969 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:12:56.047923 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Successfully updated port: e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:56.105570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-changed-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:56.105570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Refreshing instance network info cache due to event network-changed-e9024f22-79d3-4f7e-acd7-cd0ff360720e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:56.105570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] Acquiring lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:56.105719 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] Acquired lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:56.105766 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Refreshing network info cache for port e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:56.178704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:56.179058 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-15fd9d97-7b28-481c-8552-6586f7ef52a7. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:56.179222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:56.204924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e69e32a-6b03-4930-9691-eccad785e334 req-6a61fbbd-a687-43d3-9ae4-d614fb1229ea service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:56.205486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:56.205708 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:56.370358 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: 52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:56.516549 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:56.556133 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:56.609893 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:56.674230 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:56.708185 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:56.827073 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:56.854784 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:57.006006 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:12:57.008966 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:12:57.029056 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:12:57.029056 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:12:57.041449 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:12:57.041449 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:57.048626 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:57.056269 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:57.057586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:57.063606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:57.063606 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:57.063849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:57.063849 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:57.064056 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:12:57.064056 np0000000669 nova-compute[97951]: 
May 13 04:12:57.075086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:57.075086 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:57.075261 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:12:57.075261 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:57.075385 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:12:57.075385 np0000000669 nova-compute[97951]: 
May 13 04:12:57.282443 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:12:57.285903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Creating image(s)
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Ensure instance console log exists: /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:57.287579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:57.356472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-51b77187-4a97-49d6-adfc-c75a4d9872dc req-89c21f42-4ed1-4368-a3a5-05f832863d4b service nova] Releasing lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:57.358401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:57.358401 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:12:57.544447 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:57.558792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7f2f515-af7f-417f-aa13-dbe663c42e49 req-610a8d99-3e49-4321-86d7-d60ef5b0a99b service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:57.925352 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:58.110352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.50.100,3260]
May 13 04:12:58.110352 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.50.100,3260] successful.
May 13 04:12:58.110352 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:58.112065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.40.100,3260]
May 13 04:12:58.112065 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.40.100,3260] successful.
May 13 04:12:58.112065 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:58.126047 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:58.129060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:12:58.140086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.140086 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.140086 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:58.140297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.140297 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.140297 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:58.140523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.170s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:58.140620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:12:58.141114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:12:58.141216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:12:58.143094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.143094 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.143094 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:12:58.143094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.143094 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:12:58.143094 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:12:58.143094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.176s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:58.143293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:12:58.143633 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:12:58.143714 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:12:58.159233 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:12:58.159233 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:12:58.162987 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:58.169807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:12:58.169807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:12:58.303187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:58.303413 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-52a69c6a-c114-429e-9e88-089a268659ef. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:58.303534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:58.303641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:58.303755 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:58.385777 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating instance_info_cache with network_info: [{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:58.761056 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: 7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:58.806024 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:12:58.836016 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:58.837052 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-7519bd91-ff41-462a-bf95-4463fabca8e7. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:58.837052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:58.889220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:58.889634 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance network_info: |[{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:12:58.891273 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start _get_guest_xml network_info=[{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:12:58.897511 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:12:58.899535 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-846114652', uuid='53f03b92-4378-4cea-be96-0fa95cecf2d7'), owner=OwnerMeta(userid='7cffc8fad0694442ad05ced625bbe1ad', username='tempest-ServerActionsTestOtherA-1572513959-project-member', projectid='03c2202127ca4ec4a872d2af2f5e4576', projectname='tempest-ServerActionsTestOtherA-1572513959'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645578.8982728) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:12:58.902604 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:12:58.903994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:12:58.904412 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:12:58.908682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:12:58.908922 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:12:58.910530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:12:58.910700 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:12:58.910981 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:12:58.910981 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:12:58.911117 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:12:58.911244 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:12:58.911410 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:12:58.911642 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:12:58.911805 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:12:58.911949 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:12:58.912079 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:12:58.912656 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:12:58.933086 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-tempest.common.compute-instance-846114652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:12:58.933361 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:58.934332 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:58.935246 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:12:58.969897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:12:59.067873 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:12:59.321856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.438594 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <uuid>53f03b92-4378-4cea-be96-0fa95cecf2d7</uuid>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <name>instance-0000000a</name>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:name>tempest-tempest.common.compute-instance-846114652</nova:name>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:12:58</nova:creationTime>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:user uuid="7cffc8fad0694442ad05ced625bbe1ad">tempest-ServerActionsTestOtherA-1572513959-project-member</nova:user>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:project uuid="03c2202127ca4ec4a872d2af2f5e4576">tempest-ServerActionsTestOtherA-1572513959</nova:project>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         <nova:port uuid="e9024f22-79d3-4f7e-acd7-cd0ff360720e">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <system>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="serial">53f03b92-4378-4cea-be96-0fa95cecf2d7</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="uuid">53f03b92-4378-4cea-be96-0fa95cecf2d7</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </system>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <os>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </os>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <features>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </features>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   <devices>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </disk>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:20:6d:f2"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <target dev="tape9024f22-79"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </interface>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/console.log" append="off"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </serial>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <video>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </video>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </rng>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:   </devices>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]: </domain>
May 13 04:12:59.438594 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:12:59.441410 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Preparing to wait for external event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:12:59.441410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:12:59.441410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:12:59.441410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:12:59.441410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-tempest.common.compute-instance-846114652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:12:59.441793 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:12:59.441793 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:12:59.441793 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:12:59.442281 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.442646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:59.442923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:12:59.443718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.443910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22287cfa-c455-51e1-b025-8823e20a3ce1', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:59.445093 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.445868 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:59.446375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.449552 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.449747 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9024f22-79, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:59.450094 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9024f22-79, col_values=(('qos', UUID('f0c21dce-6bd4-4745-8c2c-ec80b33c520a')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:59.450260 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9024f22-79, col_values=(('external_ids', {'iface-id': 'e9024f22-79d3-4f7e-acd7-cd0ff360720e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6d:f2', 'vm-uuid': '53f03b92-4378-4cea-be96-0fa95cecf2d7'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:12:59.451183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.453261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:12:59.458660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:12:59.459993 np0000000669 nova-compute[97951]: INFO os_vif [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79')
May 13 04:12:59.569812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:12:59.570122 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:59.570122 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:59.570224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:59.570270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:12:59.570444 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:12:59.819625 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Successfully updated port: d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:12:59.895887 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:12:59.896250 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-d9858795-fb99-4c2f-be09-bd2c041977c1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:12:59.896437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:12:59.987930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Found WWN 330000000cdedfc73 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:12:59.988203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:12:59.988444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] <== connect_volume: return (4037ms) {'type': 'block', 'scsi_wwn': '330000000cdedfc73', 'path': '/dev/dm-0', 'multipath_id': '330000000cdedfc73'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:12:59.988525 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cdedfc73', 'path': '/dev/dm-0', 'multipath_id': '330000000cdedfc73'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:12:59.990064 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lazy-loading 'flavor' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:00.072615 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:00.152524 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:00.323586 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:00.334290 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:00.389412 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:00.389412 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing instance network info cache due to event network-changed-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:00.389412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Acquiring lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:00.389412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Acquired lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:00.389412 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Refreshing network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:00.478777 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:00.480059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:00.493958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Attempting to attach volume b817a296-21c0-40b9-b28a-0586475b9be0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:00.494862 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] attach device xml: <disk type="block" device="disk">
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:   <alias name="ua-b817a296-21c0-40b9-b28a-0586475b9be0"/>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:   <serial>b817a296-21c0-40b9-b28a-0586475b9be0</serial>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:00.494862 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:00.835674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c64feafc-44d6-4cd2-9107-1d35fef891e6 req-1f9cd380-d95c-43d8-8481-b48c347b329b service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:00.836118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:00.836118 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:00.891416 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:00.973428 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:00.973545 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:00.973639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:20:6d:f2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:00.974007 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Using config drive
May 13 04:13:00.989366 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:01.221916 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:01.338168 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:01.413495 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updated VIF entry in instance network info cache for port fd7dcb9c-3d7f-408a-a55f-fec1a2de0135. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:13:01.413799 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating instance_info_cache with network_info: [{"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:01.458336 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:01.480606 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:01.637639 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating config drive at /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config
May 13 04:13:01.642097 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:01.650408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgvbk3ozu {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:01.687162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgvbk3ozu" returned: 0 in 0.037s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:01.917045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Releasing lock "refresh_cache-30a3c85b-773d-4859-b01e-a751646ff4b1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:01.917468 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-changed-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:01.917523 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Refreshing instance network info cache due to event network-changed-8015fd9c-c636-4335-a881-63aef7924875. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:01.917737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Acquiring lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:01.917873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Acquired lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:01.918015 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Refreshing network info cache for port 8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:01.994565 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:02.146445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2cb0074-ec67-4afb-8ab8-d9eba8ec0549 req-217c246a-1fc5-4339-b609-ff75f0c089eb service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:02.146445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:02.146445 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:02.146445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:02.170899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:02.184833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:02.184994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:02.185138 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:02.185254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] No VIF found with MAC fa:16:3e:57:9f:56, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:02.255701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:02.295250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:02.296521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:02.351292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2201c22e-a675-45cf-85f9-6112c2688688 req-367731f6-cdb6-4e32-9700-f941b93e577e service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:02.351831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2201c22e-a675-45cf-85f9-6112c2688688 req-367731f6-cdb6-4e32-9700-f941b93e577e service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:02.352043 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2201c22e-a675-45cf-85f9-6112c2688688 req-367731f6-cdb6-4e32-9700-f941b93e577e service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:02.352214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2201c22e-a675-45cf-85f9-6112c2688688 req-367731f6-cdb6-4e32-9700-f941b93e577e service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:02.352425 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2201c22e-a675-45cf-85f9-6112c2688688 req-367731f6-cdb6-4e32-9700-f941b93e577e service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Processing event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:02.421252 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:02.647566 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:02.724798 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:02.734137 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:02.864004 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updated VIF entry in instance network info cache for port 8015fd9c-c636-4335-a881-63aef7924875. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:13:02.864248 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updating instance_info_cache with network_info: [{"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:02.872131 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:02.932181 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645582.9317489, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:02.932758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:13:02.933045 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Started (Lifecycle Event)
May 13 04:13:02.934785 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:13:02.937608 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance spawned successfully.
May 13 04:13:02.937855 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:13:03.243821 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:03.249164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:03.366269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4931755c-abf7-4030-a203-0e44ce84ba17 req-5b616279-7714-47d6-b16e-7054969f2dac service nova] Releasing lock "refresh_cache-6954b4b1-9bab-4c57-87fa-0dca61e5daf8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:03.374082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29294916-a937-4698-8848-d66cc68f5d56 req-dac3d317-32a7-4845-88dd-5507247df08f service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:03.375493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:03.375493 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:03.412234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:03.412454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:03.412699 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Attaching volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d to /dev/vdb
May 13 04:13:03.437467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:03.444387 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:03.445402 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.445522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.445924 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.446162 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.446727 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.446960 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:03.458360 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:03.472592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:03.497392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:03.525626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:03.528889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:03.536948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:03.538173 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe20:6df2'] 
May 13 04:13:03.538277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:03.538433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:03.538666 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:03.538881 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating existing volume attachment record: eda9a098-7a63-4075-b414-4485bb98819d {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:03.755223 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lazy-loading 'flavor' on Instance uuid 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:03.764430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0de41dc3-554f-4d4a-835a-c4f21f942ae3 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.608s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:03.946633 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:13:03.946633 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645583.945225, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:03.946633 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Paused (Lifecycle Event)
May 13 04:13:03.954233 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Took 8.54 seconds to spawn the instance on the hypervisor.
May 13 04:13:03.954549 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:03.976796 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:04.096968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:04.097238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:04.097395 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:04.097778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:04.097941 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:04.109196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:04.109649 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:04.110002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:04.110146 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:04.110603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:04.110603 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:04.124149 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:04.124149 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:04.129784 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:04.129784 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d] added
May 13 04:13:04.137588 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:04.137588 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:04.137588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:04.138350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:04.138350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:04.141255 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d] added
May 13 04:13:04.141255 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:04.141255 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:04.141255 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:04.141255 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:04.141255 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:04.141255 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:04.142458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:04.142458 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:04.142458 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:04.173361 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:04.256779 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] volume_snapshot_create: create_info: {'snapshot_id': '3f971b3a-8081-418f-ac31-c4ed0517057b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=97951) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 13 04:13:04.262014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] snap xml: <domainsnapshot>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:   <disks>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:     <disk name="/dev/dm-0" snapshot="external" type="file">
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:       <source file="/dev/new_file"/>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:     <disk name="vda" snapshot="no"/>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:     <disk name="hda" snapshot="no"/>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:   </disks>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]: </domainsnapshot>
May 13 04:13:04.262014 np0000000669 nova-compute[97951]:  {{(pid=97951) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 13 04:13:04.262014 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] Lazy-loading 'system_metadata' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:04.339106 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:04.423840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:04.423840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:04.423840 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:04.448657 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:04.449572 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645584.4493883, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:04.450862 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Resumed (Lifecycle Event)
May 13 04:13:04.452430 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:04.474659 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Took 14.38 seconds to build instance.
May 13 04:13:04.487238 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b261ffbb-a75e-4f8b-9ad0-b3b113fccd06 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] volume_snapshot_delete: delete_info: {'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0'} {{(pid=97951) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [None req-b261ffbb-a75e-4f8b-9ad0-b3b113fccd06 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Traceback (most recent call last):
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     self._volume_snapshot_delete(context, instance, volume_id,
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     if delete_info['type'] != 'qcow2':
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]        ~~~~~~~~~~~^^^^^^^^
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] KeyError: 'type'
May 13 04:13:04.492466 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] 
May 13 04:13:04.507101 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:04.507596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:04.507748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:04.507862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:04.509621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:04.509621 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3374f480-02a1-48a1-8f4b-eb1fa0b47539 req-4853a362-8c1e-4540-84de-d6982130cdd0 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state active and task_state None.
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [None req-b261ffbb-a75e-4f8b-9ad0-b3b113fccd06 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-25ba24e3-d034-4c42-86cb-c896680174bc)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 04:13:04.536142 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 13 04:13:04.537150 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server [None req-b261ffbb-a75e-4f8b-9ad0-b3b113fccd06 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] Exception during message handling: KeyError: 'type'
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 13 04:13:04.543858 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server 
May 13 04:13:04.578969 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:04.765377 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 04:13:04.770774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Traceback (most recent call last):
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.774565 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] 
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Traceback (most recent call last):
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     self._volume_snapshot_create(context, instance, guest,
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.774997 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] 
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3f971b3a-8081-418f-ac31-c4ed0517057b could not be found.
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3f971b3a-8081-418f-ac31-c4ed0517057b could not be found. (HTTP 404) (Request-ID: req-6aa668e5-dcad-475b-b382-4173f2d1696d)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 04:13:04.810301 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3f971b3a-8081-418f-ac31-c4ed0517057b could not be found.
May 13 04:13:04.811418 np0000000669 nova-compute[97951]: ERROR nova.virt.libvirt.driver 
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server [None req-5f135008-5739-45d1-8aa5-23b11f72c0c9 tempest-VolumesAssistedSnapshotsTest-1902518918 tempest-VolumesAssistedSnapshotsTest-1902518918-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 04:13:04.815220 np0000000669 nova-compute[97951]: ERROR oslo_messaging.rpc.server 
May 13 04:13:04.925193 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:04.956157 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:04.959842 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:04.975040 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:04.981480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.892s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:05.139460 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:05.141951 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'pci_requests' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:05.144966 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:05.157421 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:05.157421 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:05.163984 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:05.163984 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.173776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.180956 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.191758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.191758 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.191758 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.191758 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.191758 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:05.192206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.192206 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.192206 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.192206 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.192206 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.196399 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:05.245600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.50.100,3260]
May 13 04:13:05.245600 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.50.100,3260] successful.
May 13 04:13:05.245600 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.256713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:05.257070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:05.260785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.265939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.40.100,3260]
May 13 04:13:05.265939 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.40.100,3260] successful.
May 13 04:13:05.265939 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.279877 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.280667 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:05.281516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:05.282181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:05.283530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:05.283530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:05.283839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:05.302174 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:05.302174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:05.304696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:05.304696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:05.307999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:05.308173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:05.325808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:05.326067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:05.412299 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:05.644344 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Object Instance<57380f3d-d29c-4861-9806-11a9845b9f6f> lazy-loaded attributes: flavor,pci_requests {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:05.644571 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:13:05.644869 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:05.645146 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:05.762715 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Detaching volume b817a296-21c0-40b9-b28a-0586475b9be0
May 13 04:13:05.767577 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9ed67d1e9a41fcb16cffa5bf1455d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad8d1e0dd3a4863abd238a6abea29d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:13:05.802919 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:05.819915 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Attempting to driver detach volume b817a296-21c0-40b9-b28a-0586475b9be0 from mountpoint /dev/vdb
May 13 04:13:05.826497 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Found disk vdb by alias ua-b817a296-21c0-40b9-b28a-0586475b9be0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:05.828265 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Found disk vdb by alias ua-b817a296-21c0-40b9-b28a-0586475b9be0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:05.828426 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Attempting to detach device vdb from instance f35e1e76-19d7-4055-920e-ec4242cd9619 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:05.828701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] detach device xml: <disk type="block" device="disk">
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <alias name="ua-b817a296-21c0-40b9-b28a-0586475b9be0"/>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <serial>b817a296-21c0-40b9-b28a-0586475b9be0</serial>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:05.828701 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:05.834500 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Successfully detached device vdb from instance f35e1e76-19d7-4055-920e-ec4242cd9619 from the persistent domain config.
May 13 04:13:05.834737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] (1/8): Attempting to detach device vdb with device alias ua-b817a296-21c0-40b9-b28a-0586475b9be0 from instance f35e1e76-19d7-4055-920e-ec4242cd9619 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:05.835044 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] detach device xml: <disk type="block" device="disk">
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <alias name="ua-b817a296-21c0-40b9-b28a-0586475b9be0"/>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <serial>b817a296-21c0-40b9-b28a-0586475b9be0</serial>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:05.835044 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:06.110671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:06.112693 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:06.177565 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Successfully created port: e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:06.326369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:06.327517 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:06.327517 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Attaching volume 19fa86bf-1165-4d2d-bdeb-914ace67538f to /dev/sdc
May 13 04:13:06.343610 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-b817a296-21c0-40b9-b28a-0586475b9be0 for instance f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:06.346061 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645586.343659, f35e1e76-19d7-4055-920e-ec4242cd9619 => ua-b817a296-21c0-40b9-b28a-0586475b9be0> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:06.347807 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Successfully detached device vdb from instance f35e1e76-19d7-4055-920e-ec4242cd9619 from the live domain config.
May 13 04:13:06.348554 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:06.348933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:06.349660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:06.376719 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:06.388266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:06.412349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:06.437376 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:06.438345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:06.446571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:06.448519 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe20:6df2'] 
May 13 04:13:06.449339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:06.449339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:06.449339 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:06.449724 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating existing volume attachment record: 8631abd4-44b4-4a8d-963d-b41fb4a72dd7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:06.609663 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:06.623782 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-changed-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:06.623782 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Refreshing instance network info cache due to event network-changed-e9024f22-79d3-4f7e-acd7-cd0ff360720e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:06.623959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] Acquiring lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:06.628064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] Acquired lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:06.628064 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Refreshing network info cache for port e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:06.699484 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Successfully updated port: e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:06.758313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-changed-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:06.758313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing instance network info cache due to event network-changed-e3f61b03-14e5-4275-83f4-86f7ce1101b8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:06.758313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:06.758313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:06.758313 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Refreshing network info cache for port e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:06.794857 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:06.882502 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:06.882977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:07.125168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found WWN 33000000094c038af for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:07.125655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:07.125655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '33000000094c038af', 'path': '/dev/dm-4', 'multipath_id': '33000000094c038af'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:07.125785 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094c038af', 'path': '/dev/dm-4', 'multipath_id': '33000000094c038af'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:07.126441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.777s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:07.126897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b817a296-21c0-40b9-b28a-0586475b9be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:07.127067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:07.127782 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:07.131963 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:07.152640 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0 (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:07.153114 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:07.153114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', '6')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:07.153846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0', '5')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:07.154537 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b6200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'): ({'sdb'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:07.154727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:07.154966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Flush multipath device 330000000cdedfc73 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:07.189160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:07.193808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:07.193808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:07.193808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:07.201513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:07.233698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:07.259059 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:07.271911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:07.272067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:07.272852 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:07.289031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:07.289256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:07.296265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:07.296265 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance network_info: |[{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:13:07.298709 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Start _get_guest_xml network_info=[{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4', 'attached_at': '', 'detached_at': '', 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'serial': '459369df-c0de-4c59-98d8-d3b616f7dd28'}, 'disk_bus': 'virtio', 'attachment_id': '03177762-6f79-451a-9f1a-d41815c17616', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4', 'attached_at': '', 'detached_at': '', 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'serial': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'}, 'disk_bus': 'virtio', 'attachment_id': '6721acf6-1b44-432a-84b0-10b248cad7d6', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4', 'attached_at': '', 'detached_at': '', 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'serial': '8eda2b22-e827-4553-8dfe-f381270476a8'}, 'disk_bus': 'virtio', 'attachment_id': '348a5004-3086-4305-92f6-2c80498ad17b', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:13:07.299859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.303515 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:07.305117 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-502767274', uuid='2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'), owner=OwnerMeta(userid='8d61d62838a74be387b7339e3ae75fd1', username='tempest-TaggedBootDevicesTest_v242-900760130-project-member', projectid='3c9f82df01ea4b71bca6616768a403f5', projectname='tempest-TaggedBootDevicesTest_v242-900760130'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645587.3045495) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:07.310501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:13:07.312625 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:13:07.317204 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:13:07.317811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:13:07.318901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:13:07.319289 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:13:07.319493 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:13:07.319623 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:13:07.319780 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:13:07.319904 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:13:07.320030 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:13:07.320224 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:13:07.320557 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:13:07.320951 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:13:07.321148 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:13:07.321723 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:13:07.338526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.40.100,3260]
May 13 04:13:07.338526 np0000000669 nova-compute[97951]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.40.100,3260] successful.
May 13 04:13:07.338526 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.339782 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:07.340340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:07.340992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:07.356652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.366593 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.386881 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:07.397058 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.50.100,3260]
May 13 04:13:07.397058 np0000000669 nova-compute[97951]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b817a296-21c0-40b9-b28a-0586475b9be0, portal: 192.168.50.100,3260] successful.
May 13 04:13:07.397058 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.409921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.410139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:07.410290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] <== disconnect_volume: return (1060ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:07.410452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:07.413648 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.220s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:07.413875 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:07.424080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:07.424758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:07.425212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:07.425400 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:07.427801 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:07.427801 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:07.436600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:07.436600 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.442093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:07.442093 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.450274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f] added
May 13 04:13:07.450274 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:07.450274 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:07.450274 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:07.450274 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:07.450274 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:07.450274 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.450524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:07.450598 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:07.450721 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:07.458217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f] added
May 13 04:13:07.458217 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:07.458217 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:07.458217 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:07.458217 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:07.458217 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:07.458217 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:07.458459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:07.458651 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:07.458831 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:07.553353 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:07.609551 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:07.634966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Attempting to attach volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:07.636121 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:07.636121 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:07.731717 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updated VIF entry in instance network info cache for port e9024f22-79d3-4f7e-acd7-cd0ff360720e. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:13:07.732033 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating instance_info_cache with network_info: [{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:07.750312 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Added VIF to instance network info cache for port e3f61b03-14e5-4275-83f4-86f7ce1101b8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3528}}
May 13 04:13:07.750839 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:07.975382 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lazy-loading 'flavor' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:08.234795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-28974acd-6090-40b2-9c32-88ff5f838719 req-a9d4cea2-2a8e-461c-9787-3e820897f2e7 service nova] Releasing lock "refresh_cache-53f03b92-4378-4cea-be96-0fa95cecf2d7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:08.253392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d71347b6-260e-412f-b117-180dc7f929a7 req-244ccea4-984a-40b2-b16e-4b4e67d5debc service nova] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:08.253708 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:08.253907 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:08.392173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:08.451258 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:08.459294 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:08.466967 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:08.466967 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:08.473525 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:08.473525 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.479688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.486597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.493774 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.493774 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.493774 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.493774 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.493774 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:08.494025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.494025 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.494025 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.494025 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.494025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:08.502422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.502422 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.502422 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.502422 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.502422 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:08.502671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.502671 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.502671 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.502671 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.502671 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:08.542912 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.40.100,3260]
May 13 04:13:08.542912 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.40.100,3260] successful.
May 13 04:13:08.542912 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.555258 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.50.100,3260]
May 13 04:13:08.555258 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.50.100,3260] successful.
May 13 04:13:08.555258 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.555855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.570643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.579220 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.579477 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:08.579645 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:08.579718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:08.580498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] HCTL ('7', '-', '-', 0) found on session 11 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:08.580600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.585965 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:08.586194 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:08.586395 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:08.586559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:08.587565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] HCTL ('8', '-', '-', 0) found on session 12 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:08.587733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:08.594776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Searching for a device in session 11 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:08.594861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:08.610104 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Searching for a device in session 12 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:08.610104 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:08.823687 np0000000669 nova-compute[97951]: WARNING nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] 5030a725-ea05-4997-96fc-137ce97049fe already exists in list: networks containing: ['5030a725-ea05-4997-96fc-137ce97049fe']. ignoring it
May 13 04:13:08.823837 np0000000669 nova-compute[97951]: WARNING nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] e3f61b03-14e5-4275-83f4-86f7ce1101b8 already exists in list: port_ids containing: ['e3f61b03-14e5-4275-83f4-86f7ce1101b8']. ignoring it
May 13 04:13:08.980358 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:08.982749 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-870e29b4-ac91-4b26-a3a3-a863157e56f1 tempest-VolumesAssistedSnapshotsTest-1933911410 tempest-VolumesAssistedSnapshotsTest-1933911410-project-admin] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.726s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:09.247161 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:09.280336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:09.280557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:09.280741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:09.282223 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No VIF found with MAC fa:16:3e:a2:4f:44, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:09.343773 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.395421 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:09.425675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:09.453195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.467945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:09.468187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:09.468421 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attaching volume 559a15a3-843d-4a18-9b34-952b883984c9 to /dev/vdb
May 13 04:13:09.502591 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:09.514307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:09.536548 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:09.565189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:09.565523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:09.573257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:09.574552 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe57:9f56', 'fe80::3098:8eff:fec8:6cc0', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe20:6df2'] 
May 13 04:13:09.574681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:09.574752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:09.574969 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:09.575224 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating existing volume attachment record: 6ae34f69-9dde-4a4a-b0a2-437ff51e8ef9 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:09.897844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:09.900360 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:09.900571 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:09.901312 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:09.901629 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:09.902013 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.902286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:09.902577 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:09.903581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.903706 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecaede74-ae87-52b5-96d8-a719c0f1e760', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:09.904685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.905483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:09.905550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.907476 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.907590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3f61b03-14, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:09.907857 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3f61b03-14, col_values=(('qos', UUID('e7fa21ec-1d4e-4092-9eaf-d7ec387be89d')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:09.908022 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3f61b03-14, col_values=(('external_ids', {'iface-id': 'e3f61b03-14e5-4275-83f4-86f7ce1101b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:65:22', 'vm-uuid': '57380f3d-d29c-4861-9806-11a9845b9f6f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:09.908908 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.909657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:09.914123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.914788 np0000000669 nova-compute[97951]: INFO os_vif [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14')
May 13 04:13:09.915346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:09.915480 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:09.916353 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:09.917346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] attach device xml: <interface type="ethernet">
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:   <mac address="fa:16:3e:9d:65:22"/>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:   <model type="virtio"/>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:   <driver name="qemu"/>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:   <mtu size="1372"/>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:   <target dev="tape3f61b03-14"/>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]: </interface>
May 13 04:13:09.917346 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:09.928023 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.984923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.987098 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:09.989796 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.042941 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.121190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:10.121572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:10.121740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:10.174374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:10.174883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:10.175034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:10.175208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:10.175306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:10.175444 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-089d3b44-9a54-4c35-9b31-1ab18a9f10ef req-b05aa97e-c24a-4d24-a17e-6c8799620d0f service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 for instance with vm_state active and task_state None.
May 13 04:13:10.242108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.253290 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.275217 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.275851 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:10.445855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Found WWN 330000000146649de for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:10.446433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:10.446669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] <== connect_volume: return (3252ms) {'type': 'block', 'scsi_wwn': '330000000146649de', 'path': '/dev/dm-0', 'multipath_id': '330000000146649de'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:10.446830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000146649de', 'path': '/dev/dm-0', 'multipath_id': '330000000146649de'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:10.447691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.106s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:10.447691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:10.449895 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lazy-loading 'flavor' on Instance uuid 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:10.462440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:10.463078 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:10.463793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:10.464029 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:10.464564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:10.464752 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:10.477642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:10.477642 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:10.481878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:10.481878 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:10.490246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28] added
May 13 04:13:10.490246 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:10.490246 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:10.490246 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:10.490246 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:10.490246 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:10.490246 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:10.490517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:10.490640 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:10.490806 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:10.493841 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28] added
May 13 04:13:10.493841 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:10.493841 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:10.493841 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:10.493841 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:10.493841 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:10.493841 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:10.494009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:10.494243 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:10.494428 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:10.858705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-768c8372-89f9-4c00-bb0e-f298d179de28 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.446s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:10.909764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:10.909939 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:10.910054 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:10.910182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:10.910280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:10.912359 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Terminating instance
May 13 04:13:10.953586 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <alias name="ua-19fa86bf-1165-4d2d-bdeb-914ace67538f"/>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <target dev="sdc" bus="scsi"/>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <serial>19fa86bf-1165-4d2d-bdeb-914ace67538f</serial>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:   <address type="drive" controller="0" unit="2"/>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:10.953586 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:11.386341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:11.386838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:11.415083 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:13:11.437676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.443061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.467814 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.471531 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.491931 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:11.496984 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:11.497118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.497732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:11.512354 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:11.512354 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:11.522974 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:11.522974 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.530866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.540123 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.552119 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.552354 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.559342 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.559710 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:11.583488 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:11.583636 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:11.583813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No VIF found with MAC fa:16:3e:ee:7b:c2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:11.600691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.40.100,3260]
May 13 04:13:11.600691 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.40.100,3260] successful.
May 13 04:13:11.600691 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.609572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.50.100,3260]
May 13 04:13:11.609572 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.50.100,3260] successful.
May 13 04:13:11.609572 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.616990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.626611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.637854 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.638301 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:11.638621 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:11.638621 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:11.639785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('13', '-', '-', 0) found on session 13 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:11.639785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.665402 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:11.665885 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:11.666237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:11.666800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:11.667881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 13 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:11.668074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:11.669534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('14', '-', '-', 0) found on session 14 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:11.669683 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:11.691826 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 14 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:11.692161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:11.761239 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999687386999994 future=<Future at 0x7a464836e090 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:11.761858 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999059547000115 future=<Future at 0x7a464836e090 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:11.761968 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998915844000066 future=<Future at 0x7a464836e090 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:11.764197 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Instance destroyed successfully.
May 13 04:13:11.764197 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lazy-loading 'resources' on Instance uuid f35e1e76-19d7-4055-920e-ec4242cd9619 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:11.892214 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:12.090656 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-196565620', uuid='57380f3d-d29c-4861-9806-11a9845b9f6f'), owner=OwnerMeta(userid='9a9ed67d1e9a41fcb16cffa5bf1455d7', username='tempest-TaggedAttachmentsTest-1597568841-project-member', projectid='6ad8d1e0dd3a4863abd238a6abea29d2', projectname='tempest-TaggedAttachmentsTest-1597568841'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645592.090036) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:12.091481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:12</nova:creationTime>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     <nova:port uuid="e3f61b03-14e5-4275-83f4-86f7ce1101b8">
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.10.10.217" ipVersion="4"/>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:12.091481 np0000000669 nova-compute[97951]:  {{(pid=97951) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 04:13:12.253184 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:12.253433 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:12.254122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:12.254122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:12.254122 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:12.254245 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-plugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 for instance with vm_state active and task_state None.
May 13 04:13:12.254440 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:12.254821 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:12.255028 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:12.255208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:12.255402 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] No waiting events found dispatching network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:12.255577 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:12.255637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:12.255782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Acquiring lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:12.255893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:12.255994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:12.256138 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] No waiting events found dispatching network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:12.256240 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-00137473-bd17-4d1b-8891-45fc5b9f5dcf req-cfc31760-8453-4615-903b-8539e63f0726 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-unplugged-cecb70b9-1b26-46ff-857c-098779b38f4f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:12.265943 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1807434522',display_name='tempest-VolumesAssistedSnapshotsTest-server-1807434522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesassistedsnapshotstest-server-1807434522',id=3,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIef/eDoM7VoX6DfjnmTVBcR2X6dCRXiubuNZFlwLS+Qt+bSGKljJI82J7M4sV4QKMFN0ilYv0QoiMSLywnaDVKa8OMSkAE3FeHNOhOeLTLisPkgc74z1A9uPlMzXQ3eHg==',key_name='tempest-keypair-516633706',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:14Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c81cc9d369e54af591916abb970b9d70',ramdisk_id='',reservation_id='r-19pj15vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-346714218',owner_user_name='tempest-VolumesAssistedSnapshotsTest-346714218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05518f5e677e49a5ba493f2452458bda',uuid=f35e1e76-19d7-4055-920e-ec4242cd9619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:12.266226 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converting VIF {"id": "cecb70b9-1b26-46ff-857c-098779b38f4f", "address": "fa:16:3e:57:9f:56", "network": {"id": "d7e72244-29a9-492e-9f86-4655dd42c4e1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-960029947-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c81cc9d369e54af591916abb970b9d70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcecb70b9-1b", "ovs_interfaceid": "cecb70b9-1b26-46ff-857c-098779b38f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:12.266662 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:12.266982 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:12.268127 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.268273 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcecb70b9-1b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:12.269542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.270161 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:12.270850 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.271500 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.271639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=713483cc-c53c-4a71-ba36-a148b5e79ed1) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:12.272056 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.272462 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:12.272877 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:12.274407 np0000000669 nova-compute[97951]: INFO os_vif [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9f:56,bridge_name='br-int',has_traffic_filtering=True,id=cecb70b9-1b26-46ff-857c-098779b38f4f,network=Network(d7e72244-29a9-492e-9f86-4655dd42c4e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcecb70b9-1b')
May 13 04:13:12.274670 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Deleting instance files /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619_del
May 13 04:13:12.275337 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Deletion of /opt/stack/data/nova/instances/f35e1e76-19d7-4055-920e-ec4242cd9619_del complete
May 13 04:13:12.464905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:12.598861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b1829d5-2ced-4e01-8314-cdc3cb9ebfa2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.177s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:12.637654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No BDM found with device name sda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:12.637802 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:12.637913 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No BDM found with device name sdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:12.637954 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] No VIF found with MAC fa:16:3e:35:0a:21, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:12.780391 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Took 1.36 seconds to destroy the instance on the hypervisor.
May 13 04:13:12.781531 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:13:12.781747 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:13:12.782072 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:13:12.782376 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:12.845369 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:12.897879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:13.483781 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Found WWN 33000000061990640 for multipath device dm-5 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:13.484243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:13.484599 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== connect_volume: return (6143ms) {'type': 'block', 'scsi_wwn': '33000000061990640', 'path': '/dev/dm-5', 'multipath_id': '33000000061990640'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:13.486340 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000061990640', 'path': '/dev/dm-5', 'multipath_id': '33000000061990640'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:13.486340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.364s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:13.486340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:13.497038 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:13.497697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:13.498229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:13.498814 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:13.498880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:13.499099 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:13.509659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:13.509659 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:13.513642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:13.513642 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:13.521417 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9] added
May 13 04:13:13.521417 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:13.521417 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:13.521417 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:13.521417 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:13.521417 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:13.521417 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:13.521677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:13.521772 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:13.521946 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:13.527902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9] added
May 13 04:13:13.527902 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:13.527902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:13.527902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:13.527902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:13.527902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:13.527902 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:13.528091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:13.528281 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:13.528460 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:13.635440 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:13.635918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:13.850728 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:13.976490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:13.976695 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:13.976921 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Attaching volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d to /dev/vdb
May 13 04:13:13.989850 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:13.990203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:13.990412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:14.017056 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:14.026138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:14.046112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:14.075940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:14.076271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:14.086123 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:14.087635 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fe9d:6522', 'fe80::4881:b9ff:fec3:a2c3'] 
May 13 04:13:14.087763 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:14.087908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:14.088150 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:14.088617 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updating existing volume attachment record: cb2edce3-a33b-437b-ba69-df27e41f9099 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:14.139632 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:14.192388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ce15269-119e-442f-8d5d-59f378308a39 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.866s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:14.341124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6e19a58f-f6e7-43fe-a751-5ffb688fb8cd req-ffa95ee9-f079-4be3-a320-645cff598967 service nova] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Received event network-vif-deleted-cecb70b9-1b26-46ff-857c-098779b38f4f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:14.351040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:14.353423 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Took 1.57 seconds to deallocate network for instance.
May 13 04:13:14.522419 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:14.529033 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:14.534848 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:14.534848 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:14.543247 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:14.543247 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.550741 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.556484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.566950 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.567306 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.577710 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.578035 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:14.619194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260]
May 13 04:13:14.619194 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260] successful.
May 13 04:13:14.619194 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.632524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.656759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260]
May 13 04:13:14.656759 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260] successful.
May 13 04:13:14.656759 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.660138 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:14.660497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:14.660616 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.664812 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.665164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:14.665424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:14.665561 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:14.666996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('15', '-', '-', 0) found on session 15 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:14.667185 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:14.672585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:14.688144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 15 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:14.688144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.700110 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:14.700416 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:14.700678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:14.700856 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:14.702482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('16', '-', '-', 0) found on session 16 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:14.702539 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:14.719475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 16 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:14.719991 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:14.865341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:14.865341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:15.156878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:15.325685 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:15.325884 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:15.417077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:15.417077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:15.498731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:15.828600 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:15.918607 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Detaching volume 19fa86bf-1165-4d2d-bdeb-914ace67538f
May 13 04:13:15.962892 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Attempting to driver detach volume 19fa86bf-1165-4d2d-bdeb-914ace67538f from mountpoint /dev/sdc
May 13 04:13:15.966396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Found disk sdc by alias ua-19fa86bf-1165-4d2d-bdeb-914ace67538f {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:15.967855 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Found disk sdc by alias ua-19fa86bf-1165-4d2d-bdeb-914ace67538f {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:15.968281 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Attempting to detach device sdc from instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:15.968797 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <alias name="ua-19fa86bf-1165-4d2d-bdeb-914ace67538f"/>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <target dev="sdc" bus="scsi"/>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <serial>19fa86bf-1165-4d2d-bdeb-914ace67538f</serial>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:15.968797 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:15.975308 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Successfully detached device sdc from instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b from the persistent domain config.
May 13 04:13:15.975308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] (1/8): Attempting to detach device sdc with device alias ua-19fa86bf-1165-4d2d-bdeb-914ace67538f from instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:15.975308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <alias name="ua-19fa86bf-1165-4d2d-bdeb-914ace67538f"/>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <target dev="sdc" bus="scsi"/>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <serial>19fa86bf-1165-4d2d-bdeb-914ace67538f</serial>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:15.975308 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:16.129922 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645596.1294017, 545a546a-81c6-4bd1-ad8a-95e1afa15a0b => ua-19fa86bf-1165-4d2d-bdeb-914ace67538f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:16.134053 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-19fa86bf-1165-4d2d-bdeb-914ace67538f for instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:16.137553 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Successfully detached device sdc from instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b from the live domain config.
May 13 04:13:16.139813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:16.140154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:16.140414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:16.221167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:16.221365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:16.221423 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Attaching volume 5510c10d-c8a3-4923-b799-6854a86e5b98 to /dev/vdb
May 13 04:13:16.259387 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:16.270213 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:16.289853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:16.313118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:16.313472 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:16.320302 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:16.321961 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe35:a21', 'fe80::e008:ccff:fe10:7442', 'fe80::fc16:3eff:feee:7bc2', 'fe80::6029:5fff:fe68:bdb4', 'fe80::fc16:3eff:fe89:a6b0', 'fe80::846b:96ff:fe4a:a69e', 'fe80::fc16:3eff:fea2:4f44', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fe9d:6522', 'fe80::4881:b9ff:fec3:a2c3'] 
May 13 04:13:16.322098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:16.322201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:16.322503 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:16.322771 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating existing volume attachment record: 385f2781-6d5b-4e89-959c-bcd5f66f3646 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:16.337864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.473s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:16.390552 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Deleted allocations for instance f35e1e76-19d7-4055-920e-ec4242cd9619
May 13 04:13:16.513774 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found WWN 330000000cb608bd7 for multipath device dm-8 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:16.514136 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:16.514291 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== connect_volume: return (6392ms) {'type': 'block', 'scsi_wwn': '330000000cb608bd7', 'path': '/dev/dm-8', 'multipath_id': '330000000cb608bd7'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:16.514464 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cb608bd7', 'path': '/dev/dm-8', 'multipath_id': '330000000cb608bd7'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:16.515240 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.525s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:16.515606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:16.519165 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:16.526357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:16.526860 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:16.527477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:16.527477 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:16.528094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:16.528238 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:16.538842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:16.538842 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:16.544081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:16.544081 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad] added
May 13 04:13:16.554683 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:16.554683 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:16.554683 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:16.557059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad] added
May 13 04:13:16.557059 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:16.557059 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:16.557059 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:16.557059 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:16.557059 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:16.557059 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:16.557290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:16.557384 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:16.557494 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:16.883583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:16.883978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:16.884105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:17.021811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attempting to attach volume 559a15a3-843d-4a18-9b34-952b883984c9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:17.022720 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:   <alias name="ua-559a15a3-843d-4a18-9b34-952b883984c9"/>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-8"/>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:   <serial>559a15a3-843d-4a18-9b34-952b883984c9</serial>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:17.022720 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:17.272990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:17.402937 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ab087404-2ab2-48c9-8f52-921dba47589e tempest-VolumesAssistedSnapshotsTest-346714218 tempest-VolumesAssistedSnapshotsTest-346714218-project-member] Lock "f35e1e76-19d7-4055-920e-ec4242cd9619" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.493s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:17.553501 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:17.557866 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:17.568335 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:17.568335 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:17.572990 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:17.572990 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.581023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.585626 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.600655 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601064 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.601506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:17.646443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.50.100,3260]
May 13 04:13:17.646443 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.50.100,3260] successful.
May 13 04:13:17.646443 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.653022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.40.100,3260]
May 13 04:13:17.653022 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.40.100,3260] successful.
May 13 04:13:17.653022 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.657762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.664791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.677007 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.677349 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:17.677349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:17.677611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:17.678530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('17', '-', '-', 0) found on session 17 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:17.678637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.683085 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:17.683423 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:17.683677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:17.683945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:17.685485 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('18', '-', '-', 0) found on session 18 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:17.685612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:17.691404 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 17 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:17.691539 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:17.699759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 18 and hctl ['18', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:18.675543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:18.675923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:18.675923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:18.675923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:35:ec:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:18.699563 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 18 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:18.699709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:19.353204 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Found WWN 330000000e5791847 for multipath device dm-9 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== connect_volume: return (5558ms) {'type': 'block', 'scsi_wwn': '330000000e5791847', 'path': '/dev/dm-9', 'multipath_id': '330000000e5791847'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5791847', 'path': '/dev/dm-9', 'multipath_id': '330000000e5791847'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.889s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:19.548503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:19.563920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:19.564718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:19.564858 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:19.565487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:19.566100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:19.566303 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:19.582028 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:19.582028 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:19.586337 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:19.586337 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:19.600565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:19.608670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.621669 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.622009 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:19.622224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:19.622295 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:19.623009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] HCTL ('11', '0', '0', 0) found on session 9 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:19.623112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.632894 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:19.633299 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:19.633299 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:19.633758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:19.634143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching for a device in session 9 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:19.634975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:19.635980 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] HCTL ('12', '0', '0', 0) found on session 10 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:19.636071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:19.644666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Searching for a device in session 10 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:19.644828 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:19.718046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:20.056769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:20.057048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:20.057164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:20.230766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-89eaebb0-5e03-4398-919e-3525ac0c4272 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.762s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:20.468385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:20.468554 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:20.468727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:20.470176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97951) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 04:13:20.470673 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:20.567645 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:21.405865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.491492 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.493996 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.510308 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.531245 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.532106 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.583897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found WWN 33000000094c038af for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:21.584197 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:21.584402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] <== connect_volume: return (6923ms) {'type': 'block', 'scsi_wwn': '33000000094c038af', 'path': '/dev/dm-4', 'multipath_id': '33000000094c038af'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:21.584560 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094c038af', 'path': '/dev/dm-4', 'multipath_id': '33000000094c038af'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:21.585578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.445s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:21.585879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19fa86bf-1165-4d2d-bdeb-914ace67538f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:21.585997 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:21.588030 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:21.612698 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:21.613111 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:21.613111 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:21.613409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', '11')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:21.616366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:21.616366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:21.616366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:21.616631 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:21.616631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:21.616631 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ffa42ac4-2926-4aec-a3e5-25db541dae1d req-56a9b7a0-b5cc-4b03-ac1f-64f8c5cd797c service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state active and task_state powering-off.
May 13 04:13:21.618194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f', '12')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:21.619660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464812a2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:21.619815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:21.620033 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Flush multipath device 330000000146649de {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:21.650867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:21.684791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:21.728677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:21.728867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:21.730905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:21.742713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:21.742912 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:21.755518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.767436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.773951 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:21.792944 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.40.100,3260]
May 13 04:13:21.792944 np0000000669 nova-compute[97951]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.40.100,3260] successful.
May 13 04:13:21.792944 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.796545 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99972029699984 future=<Future at 0x7a464828a960 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:21.797636 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance destroyed successfully.
May 13 04:13:21.797933 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'numa_topology' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:21.817044 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.831074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.868278 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.50.100,3260]
May 13 04:13:21.868278 np0000000669 nova-compute[97951]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-19fa86bf-1165-4d2d-bdeb-914ace67538f, portal: 192.168.50.100,3260] successful.
May 13 04:13:21.868278 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.891455 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.891687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:21.891861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] <== disconnect_volume: return (5751ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:21.892011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:21.893959 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.010s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:21.894183 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:21.905274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:21.905769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:21.906100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:21.906246 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:21.906945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:21.907288 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:21.917243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:21.917243 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.922672 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:21.922672 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.928609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98] added
May 13 04:13:21.928609 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:21.928609 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:21.928609 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:21.928609 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:21.928609 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:21.928609 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.928764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:21.928889 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:21.929025 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:21.932666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98] added
May 13 04:13:21.932666 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:21.932666 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:21.932666 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:21.932666 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:21.932666 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:21.932666 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:21.932864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:21.933335 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:21.933529 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:22.090792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Attempting to attach volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:22.092501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:22.092501 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:22.274762 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:22.299829 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:22.300014 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:22.461953 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lazy-loading 'flavor' on Instance uuid 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:22.595384 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.595600 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.595800 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.595993 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.596184 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.596426 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.596607 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.596811 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.596939 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:13:22.597111 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:13:22.806552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d26ee95-1822-4155-b647-265e75088758 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.338s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:22.929421 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:22.933923 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:22.942242 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:22.942242 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:22.948643 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:22.948643 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:22.956001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:22.960597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.976669 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977035 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977496 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:22.977759 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:23.050985 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:23.055889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.40.100,3260]
May 13 04:13:23.055889 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.40.100,3260] successful.
May 13 04:13:23.055889 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:23.060026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.50.100,3260]
May 13 04:13:23.060026 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.50.100,3260] successful.
May 13 04:13:23.060026 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:23.067076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:23.071724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.083172 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.083676 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:23.083676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:23.084152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:23.085251 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] HCTL ('7', '-', '-', 0) found on session 19 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:23.085410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:23.090983 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:23.090983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:23.091836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:23.092085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] HCTL ('8', '-', '-', 0) found on session 20 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:23.092215 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:23.097796 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Searching for a device in session 19 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:23.097926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:23.100441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:23.100748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:23.100820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:23.101423 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:13:23.107808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Searching for a device in session 20 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:23.107808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:23.218655 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:23.466965 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9f521c4e-3246-45eb-aea7-5c93eed5edef tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.051s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:23.671291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:23.671621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:23.671717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:23.671883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:23.672552 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:23.672752 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7a365b2c-2baa-4e9f-b20b-50911e36b7e3 req-701e7d2b-45eb-4ae9-8925-07bf63c864d6 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:13:23.722865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:23.722954 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquired lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:23.723129 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:23.723268 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'info_cache' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:23.737469 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:23.737609 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:23.737777 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:23.737930 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] No VIF found with MAC fa:16:3e:89:a6:b0, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:23.906827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:23.951938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:23.952082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:23.952234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:23.952356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:23.952493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:23.955174 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Terminating instance
May 13 04:13:24.131443 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.208792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.209542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.228448 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:24.287301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.290331 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.355828 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.363905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.364335 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.431241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.431783 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:13:24.434417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.459481 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:13:24.479773 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.482390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.497914 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.502425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.512943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.514293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.521215 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.529248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:24.586969 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.590180 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.676266 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.677503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.707511 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:24.708103 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:24.708989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:24.709160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:24.709315 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] No waiting events found dispatching network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:24.709494 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad230405-43ec-4995-a49c-ab950771928a req-929318c5-5d27-449c-b398-57cdc6f6b9a9 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:24.731927 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:24.762476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.762695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:13:24.767844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.811430 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999562558999969 future=<Future at 0x7a464840be60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:24.812934 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Instance destroyed successfully.
May 13 04:13:24.813191 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lazy-loading 'resources' on Instance uuid 545a546a-81c6-4bd1-ad8a-95e1afa15a0b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:24.854072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.854611 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.927554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Found WWN 330000000f4ba66a9 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:24.928032 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:24.928214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] <== connect_volume: return (8044ms) {'type': 'block', 'scsi_wwn': '330000000f4ba66a9', 'path': '/dev/dm-0', 'multipath_id': '330000000f4ba66a9'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:24.928401 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f4ba66a9', 'path': '/dev/dm-0', 'multipath_id': '330000000f4ba66a9'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:24.929193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.872s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:24.929545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:24.934287 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:24.936508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:24.938952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:24.952188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:24.953841 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:24.954482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:24.954708 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:24.955679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:24.956924 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:24.965710 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:24.965710 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:24.973237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:24.973237 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8] added
May 13 04:13:24.977977 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:24.977977 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:24.977977 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8] added
May 13 04:13:24.984878 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:24.984878 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:24.984878 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:24.985157 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:25.016053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:25.016518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:25.097888 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:25.104170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:25.107500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:25.197251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:25.197841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:25.277073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:25.277695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:13:25.281227 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:25.282884 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:25.283892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:25.314642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf169564-2e22-4155-a7e1-ed9fcd4b26b7 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.338s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:25.315534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.031s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:25.316723 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-210853464',display_name='tempest-AttachSCSIVolumeTestJSON-server-210853464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachscsivolumetestjson-server-210853464',id=4,image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjh20ogeKi1Fb9M9yal8T8+aD5X6BRJMtuJl8V4Ks8qe+CDjfcuzg7BknJHTCI3CYxZvBZ2wmGBBPax9sLBkCTCtNRcMm9k081JsAxgbS85sOb/OTtTjm4LU5MlVqtiyg==',key_name='tempest-keypair-348629795',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:22Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ee7976e72845ffbdd292d619a145af',ramdisk_id='',reservation_id='r-wffhjrud',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e29f3ffa-abe5-4849-83e7-e51da14857ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-134677350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-134677350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4620f9393254d1c9e0db0ff59cbedf9',uuid=545a546a-81c6-4bd1-ad8a-95e1afa15a0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:25.317237 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12777MB free_disk=74.54283905029297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:13:25.317480 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converting VIF {"id": "eb924cda-7564-4072-a0b5-7cdd2199896e", "address": "fa:16:3e:35:0a:21", "network": {"id": "b2330d37-3fe5-48b1-9d7e-4100407d3a07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1355470348-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85ee7976e72845ffbdd292d619a145af", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb924cda-75", "ovs_interfaceid": "eb924cda-7564-4072-a0b5-7cdd2199896e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:25.318253 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:25.318614 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:25.318964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:25.319654 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:25.322121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.322429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb924cda-75, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:25.323687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.324574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:25.329344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.330099 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.330226 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a191a743-cfdd-40a5-81c5-8d426642f916) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:25.330734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.331151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:25.336555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:25.338158 np0000000669 nova-compute[97951]: INFO os_vif [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:0a:21,bridge_name='br-int',has_traffic_filtering=True,id=eb924cda-7564-4072-a0b5-7cdd2199896e,network=Network(b2330d37-3fe5-48b1-9d7e-4100407d3a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb924cda-75')
May 13 04:13:25.338456 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Deleting instance files /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b_del
May 13 04:13:25.339127 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Deletion of /opt/stack/data/nova/instances/545a546a-81c6-4bd1-ad8a-95e1afa15a0b_del complete
May 13 04:13:25.437307 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Attempting to attach volume 5510c10d-c8a3-4923-b799-6854a86e5b98 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:25.438412 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:   <alias name="ua-5510c10d-c8a3-4923-b799-6854a86e5b98"/>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:   <serial>5510c10d-c8a3-4923-b799-6854a86e5b98</serial>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:25.438412 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:25.784971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Releasing lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:25.847707 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:13:25.851813 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:13:25.852891 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:13:25.853034 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:13:25.853303 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:25.915876 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:25.978514 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:25.986745 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:25.993160 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:25.993160 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:26.006067 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:26.006067 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.011299 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.023797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.033353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.046065 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.046369 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:26.079732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.40.100,3260]
May 13 04:13:26.079732 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.40.100,3260] successful.
May 13 04:13:26.079732 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.093788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.108018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.50.100,3260]
May 13 04:13:26.108018 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.50.100,3260] successful.
May 13 04:13:26.108018 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.119770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.120102 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.122379 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:26.122379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:26.124210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('19', '-', '-', 0) found on session 21 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:26.124515 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:26.144889 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] HCTL ('20', '-', '-', 0) found on session 22 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 21 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:26.144889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:26.159273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 22 and hctl ['20', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:26.380845 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.380956 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381046 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 57380f3d-d29c-4861-9806-11a9845b9f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381138 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381220 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 30a3c85b-773d-4859-b01e-a751646ff4b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381312 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c230a3ec-2c84-425b-b594-f0c669d01bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381488 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381568 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:13:26.381753 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:13:26.381872 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:13:25 up 27 min,  2 users,  load average: 6.41, 3.53, 1.72\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_03c2202127ca4ec4a872d2af2f5e4576': '2', 'io_workload': '1', 'num_task_deleting': '1', 'num_proj_85ee7976e72845ffbdd292d619a145af': '1', 'num_proj_6ad8d1e0dd3a4863abd238a6abea29d2': '1', 'num_proj_ed385cda159c488d94beac05f00c9ebf': '2', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_32f6190e477e45ffb44a9f7754ab6965': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_3c9f82df01ea4b71bca6616768a403f5': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:13:26.479687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ed9d4f73-37b4-4384-8ab0-10b29917bf25 req-27b200ad-2b8c-4388-9be4-a105f8760d75 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-deleted-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:26.480072 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ed9d4f73-37b4-4384-8ab0-10b29917bf25 req-27b200ad-2b8c-4388-9be4-a105f8760d75 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Neutron deleted interface eb924cda-7564-4072-a0b5-7cdd2199896e; detaching it from the instance and deleting it from the info cache
May 13 04:13:26.480219 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ed9d4f73-37b4-4384-8ab0-10b29917bf25 req-27b200ad-2b8c-4388-9be4-a105f8760d75 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:26.718185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:26.718406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:26.759255 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:26.759554 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:26.761987 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0010426459998598148 future=<Future at 0x7a464836e090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:26.762101 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:26.762490 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.034022740999944 future=<Future at 0x7a464828a960 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:26.762564 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.033693008 future=<Future at 0x7a464828a960 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:26.763514 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Emitting event <LifecycleEvent: 1778645591.760824, f35e1e76-19d7-4055-920e-ec4242cd9619 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:26.763663 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] VM Stopped (Lifecycle Event)
May 13 04:13:26.785679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:26.785679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] Acquiring lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:26.785679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:26.786093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:26.786093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] No waiting events found dispatching network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:26.786093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a5d937b4-ca61-414e-82ae-ead08e08883b req-7db65892-614a-469d-ad04-a03759d09cbd service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Received event network-vif-unplugged-eb924cda-7564-4072-a0b5-7cdd2199896e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:26.795671 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance destroyed successfully.
May 13 04:13:26.796000 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'numa_topology' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:26.925599 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:26.983493 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ed9d4f73-37b4-4384-8ab0-10b29917bf25 req-27b200ad-2b8c-4388-9be4-a105f8760d75 service nova] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Detach interface failed, port_id=eb924cda-7564-4072-a0b5-7cdd2199896e, reason: Instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:13:27.086173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:27.086503 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:27.086661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] No VIF found with MAC fa:16:3e:ee:7b:c2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:27.158223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Searching for a device in session 22 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:27.158468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:27.220732 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Detaching volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:27.263915 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:27.271349 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Attempting to driver detach volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d from mountpoint /dev/vdb
May 13 04:13:27.272584 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: f35e1e76-19d7-4055-920e-ec4242cd9619] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:27.279076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found disk vdb by alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:27.283809 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found disk vdb by alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:27.283945 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Attempting to detach device vdb from instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:27.284151 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:27.284151 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:27.295316 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully detached device vdb from instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 from the persistent domain config.
May 13 04:13:27.295789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] (1/8): Attempting to detach device vdb with device alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d from instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:27.296164 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:27.296164 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:27.297696 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:27.298052 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'resources' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:27.428449 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Took 1.57 seconds to deallocate network for instance.
May 13 04:13:27.776407 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:13:27.776546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.458s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:27.776819 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.31 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:13:27.799896 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:27.800463 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:27.800613 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:27.801110 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:27.801297 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:27.802163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.802404 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0bec8c6-18, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:27.803454 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.804215 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:27.804745 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.805392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.805526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76b46c7f-2c51-4f82-a47b-520412037f3a) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:27.806001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.806650 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:27.806989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:27.809224 np0000000669 nova-compute[97951]: INFO os_vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:13:27.812867 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:27.813139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:27.813265 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:27.815804 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645607.8154652, 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 => ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:27.817114 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d for instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:27.818634 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully detached device vdb from instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 from the live domain config.
May 13 04:13:27.933139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:27.933305 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:27.975090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Found WWN 3300000005feea97b for multipath device dm-10 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:27.976312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:27.976312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== connect_volume: return (7918ms) {'type': 'block', 'scsi_wwn': '3300000005feea97b', 'path': '/dev/dm-10', 'multipath_id': '3300000005feea97b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:27.976312 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005feea97b', 'path': '/dev/dm-10', 'multipath_id': '3300000005feea97b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:27.976940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.163s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:27.977418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:27.977619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:28.006192 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:28.006604 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:28.006868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:28.006868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '16')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:28.008247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '15')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:28.010003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648283240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:28.010254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:28.010546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flush multipath device 330000000cb608bd7 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:28.039902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:28.089940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:28.139305 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:28.139529 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:28.141576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:28.151952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:28.152317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:28.164953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.203501 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260]
May 13 04:13:28.203501 np0000000669 nova-compute[97951]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260] successful.
May 13 04:13:28.203501 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.228575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.242345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.280745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260]
May 13 04:13:28.280745 np0000000669 nova-compute[97951]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260] successful.
May 13 04:13:28.280745 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.302191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.302559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:28.302689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== disconnect_volume: return (489ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:28.302863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:28.307817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start _get_guest_xml network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': 'c230a3ec-2c84-425b-b594-f0c669d01bfe', 'attached_at': '', 'detached_at': '', 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'serial': '559a15a3-843d-4a18-9b34-952b883984c9'}, 'disk_bus': 'virtio', 'attachment_id': '6ae34f69-9dde-4a4a-b0a2-437ff51e8ef9', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:13:28.309921 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:28.311449 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-678076492', uuid='c230a3ec-2c84-425b-b594-f0c669d01bfe'), owner=OwnerMeta(userid='3f4d2a3b569e43219b9d28dfb3990758', username='tempest-AttachVolumeTestJSON-1777051046-project-member', projectid='32f6190e477e45ffb44a9f7754ab6965', projectname='tempest-AttachVolumeTestJSON-1777051046'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645608.310823) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:28.312449 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:13:28.312627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:13:28.313401 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:13:28.313621 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:13:28.314652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:13:28.314980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:13:28.315136 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:13:28.315254 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:13:28.315435 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:13:28.315667 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:13:28.315667 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:13:28.315990 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:13:28.316126 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:13:28.316269 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:13:28.316449 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:13:28.316598 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:13:28.317037 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'vcpu_model' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:28.349169 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Detected multiple connections on this host for volume: 0b829c0e-b5ee-4e32-b268-08a34afe1c9d, skipping target disconnect.
May 13 04:13:28.366075 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:28.366457 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:28.481624 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.481804 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.482298 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.482939 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.483086 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.483458 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.487452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.487930 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.488278 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:28.488431 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:28.488812 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:28.489459 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:28.490032 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:28.638793 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-015d9a0d-1853-44d1-bd49-a9226b591b87 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.417s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:28.822442 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:28.838047 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:28.876816 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:28.913876 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:28.945279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:28.948489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:28.961238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:28.961926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:28.962073 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:28.962553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:28.963084 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:28.963084 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:28.981273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:28.981273 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.985632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:28.985632 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:28.994296 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] End _get_guest_xml xml=<domain type="qemu">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <uuid>2e964c65-b87f-4c85-bbae-b83d3bb8fcb4</uuid>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <name>instance-00000009</name>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:name>tempest-device-tagging-server-502767274</nova:name>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:13:07</nova:creationTime>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:user uuid="8d61d62838a74be387b7339e3ae75fd1">tempest-TaggedBootDevicesTest_v242-900760130-project-member</nova:user>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:project uuid="3c9f82df01ea4b71bca6616768a403f5">tempest-TaggedBootDevicesTest_v242-900760130</nova:project>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="37cdbc96-1ec2-42b4-a204-e478fcc3e152">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="8bc8529f-7284-4f43-9ec5-3f81fe1525e1">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="15fd9d97-7b28-481c-8552-6586f7ef52a7">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="52a69c6a-c114-429e-9e88-089a268659ef">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="7519bd91-ff41-462a-bf95-4463fabca8e7">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         <nova:port uuid="d9858795-fb99-4c2f-be09-bd2c041977c1">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="serial">2e964c65-b87f-4c85-bbae-b83d3bb8fcb4</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="uuid">2e964c65-b87f-4c85-bbae-b83d3bb8fcb4</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/disk.config"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <alias name="ua-459369df-c0de-4c59-98d8-d3b616f7dd28"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-5"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <serial>459369df-c0de-4c59-98d8-d3b616f7dd28</serial>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <alias name="ua-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-9"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <serial>8d45a4fd-760c-4a7c-8fec-35a225ebd1ad</serial>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <alias name="ua-8eda2b22-e827-4553-8dfe-f381270476a8"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-10"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="vdc" bus="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <serial>8eda2b22-e827-4553-8dfe-f381270476a8</serial>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d0:64:85"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tap37cdbc96-1e"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:8e:81:7a"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tap8bc8529f-72"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:84:20:c7"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tap15fd9d97-7b"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:6e:5c:74"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tap52a69c6a-c1"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:be:1c:52"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tapa40f75d4-7b"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:62:0c:74"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tap7519bd91-ff"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:86:a7:66"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <target dev="tapd9858795-fb"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/console.log" append="off"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:28.994296 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9] added
May 13 04:13:29.000467 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:29.000467 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9] added
May 13 04:13:29.000467 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:29.000467 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:29.000467 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Preparing to wait for external event network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:29.001730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:29.002013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:29.002013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.003352 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.003352 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.003710 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.003991 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.005723 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.006037 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.006738 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.007502 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.007753 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45eafc61-7622-5292-9157-909f81bb70c9', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.008749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.009221 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.009644 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.011503 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.011706 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37cdbc96-1e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.012067 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37cdbc96-1e, col_values=(('qos', UUID('314c6285-e4d2-4737-8dd4-1bb887c662a0')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.012190 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37cdbc96-1e, col_values=(('external_ids', {'iface-id': '37cdbc96-1ec2-42b4-a204-e478fcc3e152', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:64:85', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.013083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.014029 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.019625 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.020679 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e')
May 13 04:13:29.021554 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.021706 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.022288 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.022563 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.023042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.023042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.023129 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.023895 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.024047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ffd3f56-ddda-5bbc-89f1-28a3edf7b9a8', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.024807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.025257 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.029987 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.031946 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.032148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc8529f-72, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.032472 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bc8529f-72, col_values=(('qos', UUID('4d32149e-8c0a-4cbf-9c5d-92ca7256c9bf')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.032633 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bc8529f-72, col_values=(('external_ids', {'iface-id': '8bc8529f-7284-4f43-9ec5-3f81fe1525e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:81:7a', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.033480 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.034549 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.043001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.043966 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72')
May 13 04:13:29.044810 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.045056 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.045547 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.045800 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.046051 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.046246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.046456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.047727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.047891 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02091734-4bb6-5617-8c46-f083fe9b0edf', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.048717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.049401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.057239 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.059150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.059291 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15fd9d97-7b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.059618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15fd9d97-7b, col_values=(('qos', UUID('510d9ac4-c07e-4a97-b520-6c58e06e2c5a')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.059746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15fd9d97-7b, col_values=(('external_ids', {'iface-id': '15fd9d97-7b28-481c-8552-6586f7ef52a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:20:c7', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.060672 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.061486 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.074390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.075337 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b')
May 13 04:13:29.076160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.076347 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.076925 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.077173 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.077420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.077577 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.077717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.078559 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.078646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2f0851e-7c50-58ca-8214-021556a66e32', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.079167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.079871 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.093165 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.095177 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.095334 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52a69c6a-c1, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.095691 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52a69c6a-c1, col_values=(('qos', UUID('e31d08ca-ae96-4cb3-a60a-3c7a0c094047')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.095825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52a69c6a-c1, col_values=(('external_ids', {'iface-id': '52a69c6a-c114-429e-9e88-089a268659ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:5c:74', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.096607 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.097894 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.114546 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.115819 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1')
May 13 04:13:29.116525 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.116667 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.117109 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.117331 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.117687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.117856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.118030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.118919 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.119078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fc622b8-cdb1-56f9-bc62-7de22576e7d4', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.120237 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.120545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.136496 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.138882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.139083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa40f75d4-7b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.139421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa40f75d4-7b, col_values=(('qos', UUID('2760d05c-60b2-47ec-a94f-a06fabb4809d')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.139601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa40f75d4-7b, col_values=(('external_ids', {'iface-id': 'a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:1c:52', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.140286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.142019 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.161881 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.162694 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b')
May 13 04:13:29.163488 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.163821 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.164260 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.164487 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.164759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.164945 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.165109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.166026 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.166176 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a34021b-979b-5337-a975-c46dec61d968', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.166825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.167571 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.186749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.188825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.188949 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7519bd91-ff, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.189203 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7519bd91-ff, col_values=(('qos', UUID('ee4f9956-4909-466c-855c-7db306bd85b5')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.189351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7519bd91-ff, col_values=(('external_ids', {'iface-id': '7519bd91-ff41-462a-bf95-4463fabca8e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:0c:74', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.189976 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.191285 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.220576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.221351 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff')
May 13 04:13:29.222429 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:29.222429 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:29.223072 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:29.223200 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:29.223451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.223667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.223863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:29.224902 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.225070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '600df87b-1c3f-536a-8000-7582af7fdda3', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.225622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.226415 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.252463 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.254678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.255011 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9858795-fb, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.255198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9858795-fb, col_values=(('qos', UUID('383ed798-f7dd-405e-8a87-3162dae14e90')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.255347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9858795-fb, col_values=(('external_ids', {'iface-id': 'd9858795-fb99-4c2f-be09-bd2c041977c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:a7:66', 'vm-uuid': '2e964c65-b87f-4c85-bbae-b83d3bb8fcb4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:29.256142 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.257244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:29.288482 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.289303 np0000000669 nova-compute[97951]: INFO os_vif [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb')
May 13 04:13:29.357807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:29.398058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.464s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:29.476153 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Deleted allocations for instance 545a546a-81c6-4bd1-ad8a-95e1afa15a0b
May 13 04:13:29.920561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f2fa5366-f811-4552-b15e-1438abdb3cba tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:30.000846 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:30.001807 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:30.016915 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:30.016915 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:30.026066 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:30.026066 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.029443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.039217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.049980 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.050506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.056780 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.057188 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:30.099345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260]
May 13 04:13:30.099345 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260] successful.
May 13 04:13:30.099345 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.113183 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260]
May 13 04:13:30.113183 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260] successful.
May 13 04:13:30.113183 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.114162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.126274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.143833 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.144189 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:30.144462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:30.144462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:30.145603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('9', '-', '-', 0) found on session 23 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:30.145739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.153876 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:30.154506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:30.154506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:30.155000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:30.156060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('10', '-', '-', 0) found on session 24 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:30.156277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:30.165513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 23 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:30.165717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:30.187144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 24 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:30.187311 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:30.486953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-90e84240-99f1-4dc4-8a13-5921d89d3e8f tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Lock "545a546a-81c6-4bd1-ad8a-95e1afa15a0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.535s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:30.813717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:30.813954 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:30.814094 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] No VIF found with MAC fa:16:3e:d0:64:85, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:30.814398 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] No VIF found with MAC fa:16:3e:be:1c:52, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:30.815062 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Using config drive
May 13 04:13:30.963766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:13:31.062202 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:31.179668 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:31.179934 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:31.325788 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:31.333659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:31.333863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:31.520007 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Creating config drive at /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/disk.config
May 13 04:13:31.524354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph138wn0s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:31.575592 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph138wn0s" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:31.683356 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Detaching volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d
May 13 04:13:31.745418 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Attempting to driver detach volume 0b829c0e-b5ee-4e32-b268-08a34afe1c9d from mountpoint /dev/vdb
May 13 04:13:31.752952 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found disk vdb by alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:31.754263 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Found disk vdb by alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:31.754483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Attempting to detach device vdb from instance 30a3c85b-773d-4859-b01e-a751646ff4b1 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:31.754823 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:31.754823 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:31.761591 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully detached device vdb from instance 30a3c85b-773d-4859-b01e-a751646ff4b1 from the persistent domain config.
May 13 04:13:31.761778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] (1/8): Attempting to detach device vdb with device alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d from instance 30a3c85b-773d-4859-b01e-a751646ff4b1 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:31.762117 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <alias name="ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d"/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <serial>0b829c0e-b5ee-4e32-b268-08a34afe1c9d</serial>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:31.762117 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:31.837839 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Detaching volume 5510c10d-c8a3-4923-b799-6854a86e5b98
May 13 04:13:31.893176 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Attempting to driver detach volume 5510c10d-c8a3-4923-b799-6854a86e5b98 from mountpoint /dev/vdb
May 13 04:13:31.903612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Found disk vdb by alias ua-5510c10d-c8a3-4923-b799-6854a86e5b98 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:31.905161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Found disk vdb by alias ua-5510c10d-c8a3-4923-b799-6854a86e5b98 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:31.905282 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Attempting to detach device vdb from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:31.905534 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <alias name="ua-5510c10d-c8a3-4923-b799-6854a86e5b98"/>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <serial>5510c10d-c8a3-4923-b799-6854a86e5b98</serial>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:31.905534 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:31.915212 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully detached device vdb from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the persistent domain config.
May 13 04:13:31.915391 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] (1/8): Attempting to detach device vdb with device alias ua-5510c10d-c8a3-4923-b799-6854a86e5b98 from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:31.917086 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <alias name="ua-5510c10d-c8a3-4923-b799-6854a86e5b98"/>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <serial>5510c10d-c8a3-4923-b799-6854a86e5b98</serial>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:31.917086 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:31.980167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found WWN 330000000cb608bd7 for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:31.980756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:31.980993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000cb608bd7', 'path': '/dev/dm-1', 'multipath_id': '330000000cb608bd7'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:31.981160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cb608bd7', 'path': '/dev/dm-1', 'multipath_id': '330000000cb608bd7'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:32.105827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.168423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.246771 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.372374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.397287 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.403666 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.446454 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.487600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.492868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:32.493111 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.497715 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:32.507741 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:32.507741 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'pci_devices' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:32.537840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.540115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.574660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.594100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.606878 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5510c10d-c8a3-4923-b799-6854a86e5b98 for instance 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:32.607571 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645612.6070166, 57380f3d-d29c-4861-9806-11a9845b9f6f => ua-5510c10d-c8a3-4923-b799-6854a86e5b98> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:32.611121 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully detached device vdb from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the live domain config.
May 13 04:13:32.612126 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:32.612663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:32.612794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:32.613200 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:32.613608 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5510c10d-c8a3-4923-b799-6854a86e5b98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:32.613800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:32.654514 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '19')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:32.654514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98', '20')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:32.656140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480f4fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:32.656854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:32.657065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Flush multipath device 330000000f4ba66a9 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:32.696117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:32.733599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.747796 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:32.775530 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.784256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.804703 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:32.804930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:32.807240 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:32.823868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:32.823868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:32.840998 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:32.875377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.887392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.892589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.40.100,3260]
May 13 04:13:32.892589 np0000000669 nova-compute[97951]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.40.100,3260] successful.
May 13 04:13:32.892589 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:32.895871 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.923438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:32.950002 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:32.951436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:32.974672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad79b406-f05d-466c-856d-887ae3ecd1ca req-3e9bdde9-87ad-40e2-b929-7bd8ba5c0d35 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:32.974672 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad79b406-f05d-466c-856d-887ae3ecd1ca req-3e9bdde9-87ad-40e2-b929-7bd8ba5c0d35 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:32.975699 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad79b406-f05d-466c-856d-887ae3ecd1ca req-3e9bdde9-87ad-40e2-b929-7bd8ba5c0d35 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:32.975699 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad79b406-f05d-466c-856d-887ae3ecd1ca req-3e9bdde9-87ad-40e2-b929-7bd8ba5c0d35 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:32.976773 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad79b406-f05d-466c-856d-887ae3ecd1ca req-3e9bdde9-87ad-40e2-b929-7bd8ba5c0d35 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:32.997428 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.50.100,3260]
May 13 04:13:32.997428 np0000000669 nova-compute[97951]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-5510c10d-c8a3-4923-b799-6854a86e5b98, portal: 192.168.50.100,3260] successful.
May 13 04:13:32.997428 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:33.010019 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:33.011156 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] End _get_guest_xml xml=<domain type="qemu">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <uuid>c230a3ec-2c84-425b-b594-f0c669d01bfe</uuid>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <name>instance-00000008</name>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeTestJSON-server-678076492</nova:name>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:13:28</nova:creationTime>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:user uuid="3f4d2a3b569e43219b9d28dfb3990758">tempest-AttachVolumeTestJSON-1777051046-project-member</nova:user>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:project uuid="32f6190e477e45ffb44a9f7754ab6965">tempest-AttachVolumeTestJSON-1777051046</nova:project>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         <nova:port uuid="c0bec8c6-18c9-46f2-87ef-63d20e48e115">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="serial">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="uuid">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <alias name="ua-559a15a3-843d-4a18-9b34-952b883984c9"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-1"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <serial>559a15a3-843d-4a18-9b34-952b883984c9</serial>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:35:ec:76"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <target dev="tapc0bec8c6-18"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/console.log" append="off"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:33.011156 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:13:33.016647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:33.022661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:33.023526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:33.023708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] <== disconnect_volume: return (411ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:33.023963 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:33.054051 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.054051 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.085545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.091583 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.102580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.118567 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80d599ca-6674-4b83-ab09-b9d433f8567d req-89fb3e65-5037-4170-bcec-7c978529d766 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:33.122990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80d599ca-6674-4b83-ab09-b9d433f8567d req-89fb3e65-5037-4170-bcec-7c978529d766 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:33.122990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80d599ca-6674-4b83-ab09-b9d433f8567d req-89fb3e65-5037-4170-bcec-7c978529d766 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:33.122990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80d599ca-6674-4b83-ab09-b9d433f8567d req-89fb3e65-5037-4170-bcec-7c978529d766 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:33.122990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80d599ca-6674-4b83-ab09-b9d433f8567d req-89fb3e65-5037-4170-bcec-7c978529d766 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:33.123922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.124587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:33.125058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:33.179109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.213893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:33.214724 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:13:33.215457 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'trusted_certs' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:33.372950 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.374956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.522464 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.523740 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.614078 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:33.689867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.691129 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:33.719693 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:33.720141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:33.748568 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645613.7475824, 30a3c85b-773d-4859-b01e-a751646ff4b1 => ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:33.749061 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0b829c0e-b5ee-4e32-b268-08a34afe1c9d for instance 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:33.757943 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully detached device vdb from instance 30a3c85b-773d-4859-b01e-a751646ff4b1 from the live domain config.
May 13 04:13:33.806079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:33.807628 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:13:33.808289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:33.825913 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:33.828394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:33.828873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:33.829714 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:33.830173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:33.830421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:33.863177 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d (non-flash)
May 13 04:13:33.863647 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:33.863647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:33.863909 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '10')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:33.865060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d', '9')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:33.866251 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648217ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:33.866536 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:33.866864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Flush multipath device 33000000094c038af {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:33.893852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:33.894968 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Cannot resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:13:33.895252 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'migration_context' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:33.902671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:33.949390 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:33.994418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:33.994617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:33.996062 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:34.013368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:34.014193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:34.026306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.067681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.40.100,3260]
May 13 04:13:34.067681 np0000000669 nova-compute[97951]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.40.100,3260] successful.
May 13 04:13:34.067681 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.078920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.082889 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.093960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.109809 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.110341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.156025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.50.100,3260]
May 13 04:13:34.156025 np0000000669 nova-compute[97951]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-0b829c0e-b5ee-4e32-b268-08a34afe1c9d, portal: 192.168.50.100,3260] successful.
May 13 04:13:34.156025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.179389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:34.179579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:34.179821 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] <== disconnect_volume: return (351ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:34.179899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:34.211483 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645614.210986, 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:34.211709 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] VM Started (Lifecycle Event)
May 13 04:13:34.256363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.309374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:34.309374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:34.361870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.390950 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.392442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.398510 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:34.399046 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:34.399356 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:34.399967 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:34.400249 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:34.401018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.401431 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:34.401751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:34.403486 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.404649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfdc17cb-c158-5830-b03d-36b63cc1bb19', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:34.404649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.406359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:34.407239 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.410390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.410390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0bec8c6-18, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:34.410390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0bec8c6-18, col_values=(('qos', UUID('39b7aec6-68eb-4270-be80-9198c5aa8b64')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:34.410804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0bec8c6-18, col_values=(('external_ids', {'iface-id': 'c0bec8c6-18c9-46f2-87ef-63d20e48e115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ec:76', 'vm-uuid': 'c230a3ec-2c84-425b-b594-f0c669d01bfe'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:34.411917 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.413669 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:34.418906 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.420001 np0000000669 nova-compute[97951]: INFO os_vif [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:13:34.716955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:34.719844 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645614.7196095, 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:34.719990 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] VM Paused (Lifecycle Event)
May 13 04:13:34.748841 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'flavor' on Instance uuid 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:34.813225 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:13:34.880838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-e3f61b03-14e5-4275-83f4-86f7ce1101b8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:34.884349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-e3f61b03-14e5-4275-83f4-86f7ce1101b8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:34.903284 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:34.931435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.019108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.133526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9919101f-5b62-46db-82de-30196a6ba6f2 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.799s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.143434 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.144002 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.144479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.144852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.145540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 in dict_keys([('network-vif-plugged', '37cdbc96-1ec2-42b4-a204-e478fcc3e152'), ('network-vif-plugged', '8bc8529f-7284-4f43-9ec5-3f81fe1525e1'), ('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef'), ('network-vif-plugged', '7519bd91-ff41-462a-bf95-4463fabca8e7'), ('network-vif-plugged', 'd9858795-fb99-4c2f-be09-bd2c041977c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:35.145540 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 for instance with vm_state building and task_state spawning.
May 13 04:13:35.145540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.145832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.145832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.146650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.146838 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:35.146999 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.147585 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.147705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.148033 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.148202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 in dict_keys([('network-vif-plugged', '37cdbc96-1ec2-42b4-a204-e478fcc3e152'), ('network-vif-plugged', '8bc8529f-7284-4f43-9ec5-3f81fe1525e1'), ('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef'), ('network-vif-plugged', 'd9858795-fb99-4c2f-be09-bd2c041977c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:35.148371 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-75002442-7238-4958-b503-b0246b2ac9c0 req-5ad388a0-fc37-449a-9688-78fd447f08b3 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-7519bd91-ff41-462a-bf95-4463fabca8e7 for instance with vm_state building and task_state spawning.
May 13 04:13:35.208984 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.209059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.209225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.209403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.209567 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 in dict_keys([('network-vif-plugged', '37cdbc96-1ec2-42b4-a204-e478fcc3e152'), ('network-vif-plugged', '8bc8529f-7284-4f43-9ec5-3f81fe1525e1'), ('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef'), ('network-vif-plugged', 'd9858795-fb99-4c2f-be09-bd2c041977c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:35.209703 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 for instance with vm_state building and task_state spawning.
May 13 04:13:35.209834 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.209975 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.210124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.211684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.211866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:35.212394 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:35.212824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.212948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.213080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.213225 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 in dict_keys([('network-vif-plugged', '37cdbc96-1ec2-42b4-a204-e478fcc3e152'), ('network-vif-plugged', '8bc8529f-7284-4f43-9ec5-3f81fe1525e1'), ('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:35.213396 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-89f3adc5-5707-4561-b7e0-03b112b79828 req-ddf95af6-c144-4134-bc90-721e200f2945 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-d9858795-fb99-4c2f-be09-bd2c041977c1 for instance with vm_state building and task_state spawning.
May 13 04:13:35.222607 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:35.226547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:35.234376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.256540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.261415 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.264007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:35.295588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.297342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.388714 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:35.400913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:35.401142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:35.405118 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:13:35.405258 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Claim successful on node np0000000669
May 13 04:13:35.730785 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:13:35.759599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c474b51-175a-48e4-a0ca-7fb6d5134a2c tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.580s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:35.799093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:13:35.861439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for c230a3ec-2c84-425b-b594-f0c669d01bfe due to new event <LifecycleEvent: 1778645615.8610294, c230a3ec-2c84-425b-b594-f0c669d01bfe => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:13:35.861718 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645615.8610294, c230a3ec-2c84-425b-b594-f0c669d01bfe => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:35.862403 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:13:35.862403 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Resumed (Lifecycle Event)
May 13 04:13:35.866199 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance rebooted successfully.
May 13 04:13:35.892232 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:35.892745 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:35.893335 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:35.895163 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:35.896579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:35.897939 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Attempting to detach device tape3f61b03-14 from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:35.898162 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] detach device xml: <interface type="ethernet">
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:   <mac address="fa:16:3e:9d:65:22"/>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:   <model type="virtio"/>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:   <driver name="qemu"/>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:   <mtu size="1372"/>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:   <target dev="tape3f61b03-14"/>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]: </interface>
May 13 04:13:35.898162 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:35.901418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:35.902813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface>not found in domain: <domain type='qemu' id='5'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <name>instance-00000005</name>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <uuid>57380f3d-d29c-4861-9806-11a9845b9f6f</uuid>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:12</nova:creationTime>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <nova:port uuid="e3f61b03-14e5-4275-83f4-86f7ce1101b8">
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.10.10.217" ipVersion="4"/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <memory unit='KiB'>196608</memory>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <vcpu placement='static'>1</vcpu>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <resource>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <partition>/machine</partition>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </resource>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <sysinfo type='smbios'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='product'>OpenStack Nova</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='version'>33.1.0</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='serial'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='uuid'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <entry name='family'>Virtual Machine</entry>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <boot dev='hd'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <smbios mode='sysinfo'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <vmcoreinfo state='on'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <cpu mode='custom' match='exact' check='full'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <model fallback='forbid'>Nehalem</model>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <feature policy='require' name='hypervisor'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <clock offset='utc'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <on_poweroff>destroy</on_poweroff>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <on_reboot>restart</on_reboot>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <on_crash>destroy</on_crash>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <disk type='file' device='disk'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk' index='2'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <backingStore type='file' index='3'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:         <format type='raw'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:         <source file='/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:         <backingStore/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       </backingStore>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target dev='vda' bus='virtio'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='virtio-disk0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <disk type='file' device='cdrom'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <driver name='qemu' type='raw' cache='none'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config' index='1'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <backingStore/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target dev='hda' bus='ide'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <readonly/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='ide0-0-0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <controller type='usb' index='0' model='none'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='usb'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <controller type='pci' index='0' model='pci-root'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='pci.0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <controller type='ide' index='0'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='ide'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <interface type='ethernet'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <mac address='fa:16:3e:ee:7b:c2'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target dev='tap6047b063-3e'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <model type='virtio'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <driver name='qemu'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <mtu size='1372'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='net0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <interface type='ethernet'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <mac address='fa:16:3e:9d:65:22'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target dev='tape3f61b03-14'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <model type='virtio'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <driver name='qemu'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <mtu size='1372'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='net1'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <serial type='pty'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target type='isa-serial' port='0'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:         <model name='isa-serial'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       </target>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <console type='pty' tty='/dev/pts/4'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <target type='serial' port='0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </console>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <input type='mouse' bus='ps2'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='input0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <input type='keyboard' bus='ps2'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='input1'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <listen type='address' address='0.0.0.0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <audio id='1' type='none'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <model type='virtio' heads='1' primary='yes'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='video0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <stats period='10'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='balloon0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <rng model='virtio'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <backend model='random'>/dev/urandom</backend>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <alias name='rng0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <label>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</label>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <imagelabel>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</imagelabel>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <label>+64055:+993</label>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:     <imagelabel>+64055:+993</imagelabel>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:35.902813 np0000000669 nova-compute[97951]:  {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 04:13:35.907473 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully detached device tape3f61b03-14 from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the persistent domain config.
May 13 04:13:35.907473 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] (1/8): Attempting to detach device tape3f61b03-14 with device alias net1 from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:13:35.907473 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] detach device xml: <interface type="ethernet">
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:   <mac address="fa:16:3e:9d:65:22"/>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:   <model type="virtio"/>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:   <driver name="qemu"/>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:   <mtu size="1372"/>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:   <target dev="tape3f61b03-14"/>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]: </interface>
May 13 04:13:35.907473 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:36.009843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.010021 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:36.010212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.010457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:36.010526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:36.014680 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Terminating instance
May 13 04:13:36.121226 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.121690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:36.121690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.121872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:36.122035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:36.124997 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Terminating instance
May 13 04:13:36.172515 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba27b7ed-136f-4f4c-ab5a-012a5d698d97 req-73be3785-a902-429a-8018-bf0935fe4ca0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:36.172515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba27b7ed-136f-4f4c-ab5a-012a5d698d97 req-73be3785-a902-429a-8018-bf0935fe4ca0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.172667 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba27b7ed-136f-4f4c-ab5a-012a5d698d97 req-73be3785-a902-429a-8018-bf0935fe4ca0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:36.173283 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba27b7ed-136f-4f4c-ab5a-012a5d698d97 req-73be3785-a902-429a-8018-bf0935fe4ca0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:36.173512 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba27b7ed-136f-4f4c-ab5a-012a5d698d97 req-73be3785-a902-429a-8018-bf0935fe4ca0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:36.361872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:36.364660 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:36.371222 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:36.518766 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:13:36.541781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.547521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.572553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.632189 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:13:36.662754 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.670159 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.684873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.743818 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.764347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.787353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.797012 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0007346570000663633 future=<Future at 0x7a464828a960 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:36.797127 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:36.802448 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.0086167130000376 future=<Future at 0x7a464840be60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:36.802651 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.0082202989999587 future=<Future at 0x7a464840be60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:36.826360 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:36.877252 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:13:36.881499 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645616.8811517, c230a3ec-2c84-425b-b594-f0c669d01bfe => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:36.881701 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Started (Lifecycle Event)
May 13 04:13:36.989250 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Start waiting for the detach event from libvirt for device tape3f61b03-14 with device alias net1 for instance 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:13:37.012452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.015953 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:37.015953 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:37.017212 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.030346 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Instance destroyed successfully.
May 13 04:13:37.030346 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'resources' on Instance uuid 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:37.034112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.043531 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.047344 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Instance destroyed successfully.
May 13 04:13:37.048546 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lazy-loading 'resources' on Instance uuid 30a3c85b-773d-4859-b01e-a751646ff4b1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:37.078464 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.293006 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:37.293612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:37.293612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:37.293612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:37.294090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] No waiting events found dispatching network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:37.294090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:37.294090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:37.294364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Acquiring lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:37.294830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:37.294830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:37.295399 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] No waiting events found dispatching network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:37.295935 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e7615fa-5b20-4134-8e16-7f051c78ebda req-d8877fd8-4122-4a40-99a7-30723a25f3f8 service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-unplugged-8015fd9c-c636-4335-a881-63aef7924875 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:37.301149 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:37.302589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:37.302782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:37.302887 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:37.303062 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:37.303220 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:13:37.303416 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:37.303559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:37.303685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:37.303808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:37.303911 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:37.304007 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:13:37.304120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:37.304300 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:37.304616 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:37.304616 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:37.304830 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] No waiting events found dispatching network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:37.304982 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6785707-5962-4a69-b541-04fdc03b6b64 req-8f341b9e-c2ae-4413-b8b5-73853a21f077 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:37.386537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:37.386651 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:37.386753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:37.386868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:35:ec:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:37.387190 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-68ea7046-9c15-4011-a681-0b6adf68ca34 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:37.391180 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:37.393101 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:37.522419 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:37.536364 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-1',id=6,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:17Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=6954b4b1-9bab-4c57-87fa-0dca61e5daf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:37.536364 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "8015fd9c-c636-4335-a881-63aef7924875", "address": "fa:16:3e:89:a6:b0", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8015fd9c-c6", "ovs_interfaceid": "8015fd9c-c636-4335-a881-63aef7924875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:37.536364 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:37.536364 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:37.537058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.537277 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8015fd9c-c6, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.538485 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.539238 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.550498 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2098486800-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testmultiattachvolumeswap-server-2098486800-2',id=7,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPBt6OG8cuvMaX5ZM5unKq1Uksr1v0tovI3AyGveJVbIISXGma1/3gPjzwEjO8jFONWytCpawaWp9BpQUqq19eFKbYztK59XR3tDXJ5VCN/F26IqyUbtsTWh/E0TtUNQ==',key_name='tempest-keypair-1319383333',keypairs=<?>,launch_index=1,launched_at=2026-05-13T04:12:17Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed385cda159c488d94beac05f00c9ebf',ramdisk_id='',reservation_id='r-j9runp0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-540647060',owner_user_name='tempest-TestMultiAttachVolumeSwap-540647060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d10cee2fb02f418e9835f647d34de253',uuid=30a3c85b-773d-4859-b01e-a751646ff4b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:37.550498 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converting VIF {"id": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "address": "fa:16:3e:a2:4f:44", "network": {"id": "ada62715-a3f9-4a46-aeac-d41059febc01", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-352041964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed385cda159c488d94beac05f00c9ebf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dcb9c-3d", "ovs_interfaceid": "fd7dcb9c-3d7f-408a-a55f-fec1a2de0135", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:37.551277 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:37.551277 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:37.554441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.555852 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.556869 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd7dcb9c-3d, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.558201 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.559118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.564149 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.564821 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.565009 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efdbe556-407d-49ad-b7ec-a675876946b5) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.565566 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.566233 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.571231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.572447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.572596 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=535990ee-d43e-4ec5-882f-bee94dcbc4e9) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.573198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.573737 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.577043 np0000000669 nova-compute[97951]: INFO os_vif [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=8015fd9c-c636-4335-a881-63aef7924875,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8015fd9c-c6')
May 13 04:13:37.577043 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Deleting instance files /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8_del
May 13 04:13:37.577043 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Deletion of /opt/stack/data/nova/instances/6954b4b1-9bab-4c57-87fa-0dca61e5daf8_del complete
May 13 04:13:37.579037 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.582802 np0000000669 nova-compute[97951]: INFO os_vif [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4f:44,bridge_name='br-int',has_traffic_filtering=True,id=fd7dcb9c-3d7f-408a-a55f-fec1a2de0135,network=Network(ada62715-a3f9-4a46-aeac-d41059febc01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dcb9c-3d')
May 13 04:13:37.583136 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Deleting instance files /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1_del
May 13 04:13:37.584101 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Deletion of /opt/stack/data/nova/instances/30a3c85b-773d-4859-b01e-a751646ff4b1_del complete
May 13 04:13:37.896711 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:13:37.897732 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645617.8970513, 57380f3d-d29c-4861-9806-11a9845b9f6f => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:13:37.897821 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:37.898196 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999773495999989 future=<Future at 0x7a463c7a3a40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:37.900111 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999837652999986 future=<Future at 0x7a463c77e030 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface>not found in domain: <domain type='qemu' id='5'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <name>instance-00000005</name>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <uuid>57380f3d-d29c-4861-9806-11a9845b9f6f</uuid>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:12</nova:creationTime>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <nova:port uuid="e3f61b03-14e5-4275-83f4-86f7ce1101b8">
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.10.10.217" ipVersion="4"/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <memory unit='KiB'>196608</memory>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <vcpu placement='static'>1</vcpu>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <resource>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <partition>/machine</partition>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </resource>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <sysinfo type='smbios'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='product'>OpenStack Nova</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='version'>33.1.0</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='serial'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='uuid'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <entry name='family'>Virtual Machine</entry>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <boot dev='hd'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <smbios mode='sysinfo'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <vmcoreinfo state='on'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <cpu mode='custom' match='exact' check='full'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <model fallback='forbid'>Nehalem</model>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <feature policy='require' name='hypervisor'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <clock offset='utc'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <on_poweroff>destroy</on_poweroff>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <on_reboot>restart</on_reboot>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <on_crash>destroy</on_crash>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <disk type='file' device='disk'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk' index='2'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <backingStore type='file' index='3'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:         <format type='raw'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:         <source file='/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:         <backingStore/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       </backingStore>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <target dev='vda' bus='virtio'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='virtio-disk0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <disk type='file' device='cdrom'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <driver name='qemu' type='raw' cache='none'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config' index='1'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <backingStore/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <target dev='hda' bus='ide'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <readonly/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='ide0-0-0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <controller type='usb' index='0' model='none'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='usb'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <controller type='pci' index='0' model='pci-root'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='pci.0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <controller type='ide' index='0'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='ide'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <interface type='ethernet'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <mac address='fa:16:3e:ee:7b:c2'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <target dev='tap6047b063-3e'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <model type='virtio'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <driver name='qemu'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <mtu size='1372'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='net0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <serial type='pty'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <target type='isa-serial' port='0'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:         <model name='isa-serial'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       </target>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <console type='pty' tty='/dev/pts/4'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <target type='serial' port='0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </console>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <input type='mouse' bus='ps2'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='input0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <input type='keyboard' bus='ps2'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='input1'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <listen type='address' address='0.0.0.0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <audio id='1' type='none'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <model type='virtio' heads='1' primary='yes'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='video0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <stats period='10'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='balloon0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <rng model='virtio'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <backend model='random'>/dev/urandom</backend>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <alias name='rng0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <label>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</label>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <imagelabel>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</imagelabel>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <label>+64055:+993</label>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:     <imagelabel>+64055:+993</imagelabel>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:37.906348 np0000000669 nova-compute[97951]:  {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully detached device tape3f61b03-14 from instance 57380f3d-d29c-4861-9806-11a9845b9f6f from the live domain config.
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:37.906348 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f61b03-14, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7fa21ec-1d4e-4092-9eaf-d7ec387be89d) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:37.919046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:37.920521 np0000000669 nova-compute[97951]: INFO os_vif [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14')
May 13 04:13:37.921149 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-196565620', uuid='57380f3d-d29c-4861-9806-11a9845b9f6f'), owner=OwnerMeta(userid='9a9ed67d1e9a41fcb16cffa5bf1455d7', username='tempest-TaggedAttachmentsTest-1597568841-project-member', projectid='6ad8d1e0dd3a4863abd238a6abea29d2', projectname='tempest-TaggedAttachmentsTest-1597568841'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645617.920809) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:37.921629 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:37</nova:creationTime>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:37.921629 np0000000669 nova-compute[97951]:  {{(pid=97951) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 04:13:37.923380 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:37.924439 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.029976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.628s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.030053 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:13:38.032630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.671s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.042152 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:13:38.042152 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Claim successful on node np0000000669
May 13 04:13:38.086054 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Took 1.57 seconds to destroy the instance on the hypervisor.
May 13 04:13:38.086689 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:13:38.087406 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:13:38.087406 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:13:38.087596 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.100398 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Took 1.46 seconds to destroy the instance on the hypervisor.
May 13 04:13:38.100398 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:13:38.100398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:13:38.100398 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:13:38.100398 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.242405 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.305224 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.541137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:13:38.541421 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:13:38.541992 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.541992 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 in dict_keys([('network-vif-plugged', '8bc8529f-7284-4f43-9ec5-3f81fe1525e1'), ('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 for instance with vm_state building and task_state spawning.
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.688046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.688532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.688702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.688868 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:38.689471 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.689725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.689904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.690062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.690259 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No event matching network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 in dict_keys([('network-vif-plugged', '52a69c6a-c114-429e-9e88-089a268659ef')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:13:38.690441 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 for instance with vm_state building and task_state spawning.
May 13 04:13:38.690623 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Processing event network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received unexpected event network-vif-plugged-52a69c6a-c114-429e-9e88-089a268659ef for instance with vm_state building and task_state spawning.
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:38.692675 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1c159c3e-f27e-4c70-9eca-52c4515456cc req-9c7aadd3-b2a8-47d1-ac5e-d930750856e0 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 for instance with vm_state active and task_state None.
May 13 04:13:38.693344 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance event wait completed in 4 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:13:38.696082 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645618.6957152, 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:38.696470 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:13:38.696865 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] VM Resumed (Lifecycle Event)
May 13 04:13:38.700170 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance spawned successfully.
May 13 04:13:38.700569 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:13:38.747158 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0549cd57d1904853bbc5ac5116ea7f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd34c67006f4acc8b1a4ffc4bb599c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:13:39.046082 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:13:39.167683 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:39.199641 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:39.200861 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:39.209861 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.209861 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.210099 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.211681 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.211681 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.211681 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:39.302523 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:39.309665 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Successfully created port: 8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:39.364788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:39.387843 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-deleted-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:39.389271 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Neutron deleted interface e3f61b03-14e5-4275-83f4-86f7ce1101b8; detaching it from the instance and deleting it from the info cache
May 13 04:13:39.389271 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] Acquiring lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] No waiting events found dispatching network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-unplugged-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:39.417384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e5de06d3-fba8-40b7-91cf-918bc8099f38 req-2c2ddc03-435e-42ca-9042-ef3504c9ffc1 service nova] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Received event network-vif-deleted-fd7dcb9c-3d7f-408a-a55f-fec1a2de0135 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:39.510676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:39.551788 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:13:39.672846 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Took 1.58 seconds to deallocate network for instance.
May 13 04:13:39.689894 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:39.690115 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:39.705585 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:13:39.733616 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Took 42.45 seconds to spawn the instance on the hypervisor.
May 13 04:13:39.733718 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:39.790479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:39.790479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquired lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:39.790479 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:39.804860 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Took 1.72 seconds to deallocate network for instance.
May 13 04:13:39.811616 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005325350000475737 future=<Future at 0x7a464840be60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:39.811810 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:39.811810 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.086145744000078 future=<Future at 0x7a463c7a3a40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:39.811945 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.086035362000075 future=<Future at 0x7a463c7a3a40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:39.813002 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Emitting event <LifecycleEvent: 1778645604.8107996, 545a546a-81c6-4bd1-ad8a-95e1afa15a0b => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:39.813002 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] VM Stopped (Lifecycle Event)
May 13 04:13:39.893152 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Lazy-loading 'system_metadata' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:39.972917 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Successfully updated port: 8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:40.089718 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:13:40.186057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:40.192963 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:40.246562 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Took 54.76 seconds to build instance.
May 13 04:13:40.291983 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:40.312609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:40.316226 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e68858f5-0d6d-478c-927a-500020631704 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 545a546a-81c6-4bd1-ad8a-95e1afa15a0b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:40.400170 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Lazy-loading 'flavor' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:40.475075 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:40.475795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:40.475795 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:40.564627 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:13:40.565656 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:13:40.565924 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Creating image(s)
May 13 04:13:40.570228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:40.570492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:40.571110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:40.571909 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:40.577428 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:40.578911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:40.670542 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:40.684869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:40.685732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:40.686298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:40.686842 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:40.691371 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:40.691693 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:40.713272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:40.713272 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:13:40.719399 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.533s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:40.749165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8af7168b-645c-4551-9983-29c5a7265c0c tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.276s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:40.773166 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:40.775057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:40.775310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:40.775490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:40.775668 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:40.775962 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-4877da7d-70dd-473f-a3ce-93fe655c6cdf req-b45e949f-a33b-45cf-bbc0-9bb2e8683070 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received unexpected event network-vif-unplugged-e3f61b03-14e5-4275-83f4-86f7ce1101b8 for instance with vm_state active and task_state None.
May 13 04:13:40.790898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:40.792855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:40.836746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk 1073741824" returned: 0 in 0.044s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:40.837755 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:40.838068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:40.906213 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Object Instance<57380f3d-d29c-4861-9806-11a9845b9f6f> lazy-loaded attributes: system_metadata,flavor {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:40.907161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:40.907765 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:40.908429 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:40.910670 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:40.912072 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface>not found in domain: <domain type='qemu' id='5'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <name>instance-00000005</name>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <uuid>57380f3d-d29c-4861-9806-11a9845b9f6f</uuid>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:37</nova:creationTime>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <memory unit='KiB'>196608</memory>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <vcpu placement='static'>1</vcpu>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <resource>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <partition>/machine</partition>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </resource>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <sysinfo type='smbios'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='product'>OpenStack Nova</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='version'>33.1.0</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='serial'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='uuid'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <entry name='family'>Virtual Machine</entry>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <boot dev='hd'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <smbios mode='sysinfo'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <vmcoreinfo state='on'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <cpu mode='custom' match='exact' check='full'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <model fallback='forbid'>Nehalem</model>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <feature policy='require' name='hypervisor'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <clock offset='utc'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <on_poweroff>destroy</on_poweroff>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <on_reboot>restart</on_reboot>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <on_crash>destroy</on_crash>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <disk type='file' device='disk'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk' index='2'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <backingStore type='file' index='3'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:         <format type='raw'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:         <source file='/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:         <backingStore/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       </backingStore>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <target dev='vda' bus='virtio'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='virtio-disk0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <disk type='file' device='cdrom'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <driver name='qemu' type='raw' cache='none'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config' index='1'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <backingStore/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <target dev='hda' bus='ide'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <readonly/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='ide0-0-0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <controller type='usb' index='0' model='none'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='usb'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <controller type='pci' index='0' model='pci-root'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='pci.0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <controller type='ide' index='0'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='ide'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <interface type='ethernet'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <mac address='fa:16:3e:ee:7b:c2'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <target dev='tap6047b063-3e'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <model type='virtio'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <driver name='qemu'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <mtu size='1372'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='net0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <serial type='pty'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <target type='isa-serial' port='0'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:         <model name='isa-serial'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       </target>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <console type='pty' tty='/dev/pts/4'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <target type='serial' port='0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </console>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <input type='mouse' bus='ps2'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='input0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <input type='keyboard' bus='ps2'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='input1'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <listen type='address' address='0.0.0.0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <audio id='1' type='none'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <model type='virtio' heads='1' primary='yes'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='video0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <stats period='10'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='balloon0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <rng model='virtio'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <backend model='random'>/dev/urandom</backend>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <alias name='rng0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <label>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</label>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <imagelabel>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</imagelabel>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <label>+64055:+993</label>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:     <imagelabel>+64055:+993</imagelabel>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:40.912072 np0000000669 nova-compute[97951]:  {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 04:13:40.916107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface> {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 04:13:40.918057 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:65:22"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tape3f61b03-14"/></interface>not found in domain: <domain type='qemu' id='5'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <name>instance-00000005</name>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <uuid>57380f3d-d29c-4861-9806-11a9845b9f6f</uuid>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:37</nova:creationTime>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <memory unit='KiB'>196608</memory>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <vcpu placement='static'>1</vcpu>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <resource>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <partition>/machine</partition>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </resource>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <sysinfo type='smbios'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='product'>OpenStack Nova</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='version'>33.1.0</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='serial'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='uuid'>57380f3d-d29c-4861-9806-11a9845b9f6f</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <entry name='family'>Virtual Machine</entry>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <boot dev='hd'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <smbios mode='sysinfo'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <vmcoreinfo state='on'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <cpu mode='custom' match='exact' check='full'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <model fallback='forbid'>Nehalem</model>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <feature policy='require' name='hypervisor'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <clock offset='utc'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <on_poweroff>destroy</on_poweroff>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <on_reboot>restart</on_reboot>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <on_crash>destroy</on_crash>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <disk type='file' device='disk'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk' index='2'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <backingStore type='file' index='3'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:         <format type='raw'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:         <source file='/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:         <backingStore/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       </backingStore>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <target dev='vda' bus='virtio'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='virtio-disk0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <disk type='file' device='cdrom'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <driver name='qemu' type='raw' cache='none'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <source file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/disk.config' index='1'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <backingStore/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <target dev='hda' bus='ide'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <readonly/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='ide0-0-0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <controller type='usb' index='0' model='none'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='usb'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <controller type='pci' index='0' model='pci-root'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='pci.0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <controller type='ide' index='0'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='ide'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </controller>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <interface type='ethernet'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <mac address='fa:16:3e:ee:7b:c2'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <target dev='tap6047b063-3e'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <model type='virtio'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <driver name='qemu'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <mtu size='1372'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='net0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <serial type='pty'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <target type='isa-serial' port='0'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:         <model name='isa-serial'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       </target>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <console type='pty' tty='/dev/pts/4'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <source path='/dev/pts/4'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <log file='/opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f/console.log' append='off'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <target type='serial' port='0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='serial0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </console>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <input type='mouse' bus='ps2'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='input0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <input type='keyboard' bus='ps2'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='input1'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </input>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <listen type='address' address='0.0.0.0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </graphics>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <audio id='1' type='none'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <model type='virtio' heads='1' primary='yes'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='video0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <stats period='10'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='balloon0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <rng model='virtio'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <backend model='random'>/dev/urandom</backend>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <alias name='rng0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <label>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</label>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <imagelabel>libvirt-57380f3d-d29c-4861-9806-11a9845b9f6f</imagelabel>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <label>+64055:+993</label>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:     <imagelabel>+64055:+993</imagelabel>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:   </seclabel>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:40.918057 np0000000669 nova-compute[97951]:  {{(pid=97951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 04:13:40.922821 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Detaching interface fa:16:3e:9d:65:22 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape3f61b03-14' not found.
May 13 04:13:40.922821 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000669',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:40.922821 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Converting VIF {"id": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "address": "fa:16:3e:9d:65:22", "network": {"id": "5030a725-ea05-4997-96fc-137ce97049fe", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-79247023", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f61b03-14", "ovs_interfaceid": "e3f61b03-14e5-4275-83f4-86f7ce1101b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:40.922821 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:40.922821 np0000000669 nova-compute[97951]: DEBUG os_vif [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:40.925012 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:40.925825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f61b03-14, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:40.926295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:40.927740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:40.929198 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:13:40.929198 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:40.939704 np0000000669 nova-compute[97951]: INFO os_vif [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:65:22,bridge_name='br-int',has_traffic_filtering=True,id=e3f61b03-14e5-4275-83f4-86f7ce1101b8,network=Network(5030a725-ea05-4997-96fc-137ce97049fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f61b03-14')
May 13 04:13:40.941948 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-196565620', uuid='57380f3d-d29c-4861-9806-11a9845b9f6f'), owner=OwnerMeta(userid='9a9ed67d1e9a41fcb16cffa5bf1455d7', username='tempest-TaggedAttachmentsTest-1597568841-project-member', projectid='6ad8d1e0dd3a4863abd238a6abea29d2', projectname='tempest-TaggedAttachmentsTest-1597568841'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645620.940907) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:40.943316 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:package version="33.1.0"/>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:name>tempest-device-tagging-server-196565620</nova:name>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:creationTime>2026-05-13 04:13:40</nova:creationTime>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:flavor name="m1.nano" id="42">
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:memory>192</nova:memory>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:disk>1</nova:disk>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:swap>0</nova:swap>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:vcpus>1</nova:vcpus>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:extraSpecs>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     </nova:extraSpecs>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   </nova:flavor>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:minDisk>1</nova:minDisk>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:minRam>0</nova:minRam>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:properties>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     </nova:properties>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   </nova:image>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:owner>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:user uuid="9a9ed67d1e9a41fcb16cffa5bf1455d7">tempest-TaggedAttachmentsTest-1597568841-project-member</nova:user>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:project uuid="6ad8d1e0dd3a4863abd238a6abea29d2">tempest-TaggedAttachmentsTest-1597568841</nova:project>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   </nova:owner>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   <nova:ports>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     <nova:port uuid="6047b063-3e9b-46ea-b833-f8ffb140c6a8">
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:     </nova:port>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:   </nova:ports>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]: </nova:instance>
May 13 04:13:40.943316 np0000000669 nova-compute[97951]:  {{(pid=97951) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 04:13:40.953688 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-107b841b-13d3-4d34-a71e-b12416a541ff req-36b2e7fa-f25d-4764-bcfb-d65c9a29199a service nova] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Received event network-vif-deleted-8015fd9c-c636-4335-a881-63aef7924875 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:40.982865 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [{"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:41.024371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:41.024642 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Cannot resize image /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:13:41.024925 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:13:41.025069 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Ensure instance console log exists: /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:13:41.025388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:41.025560 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:41.025684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:41.093503 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:41.233454 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:13:41.234305 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:13:41.235821 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:41.236177 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:41.335601 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:41.377845 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0549cd57d1904853bbc5ac5116ea7f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd34c67006f4acc8b1a4ffc4bb599c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:13:41.480851 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:41.481230 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:41.495905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Releasing lock "refresh_cache-57380f3d-d29c-4861-9806-11a9845b9f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:41.570738 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-changed-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:41.570738 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Refreshing instance network info cache due to event network-changed-8a1a26a8-6c0b-4008-b136-c7a0537572af. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:41.571294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] Acquiring lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:41.648939 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:41.739805 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:13:41.909414 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Successfully created port: 8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:41.985522 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:42.005933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c410318c-275c-417e-a388-0bd0daa6e4d1 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "interface-57380f3d-d29c-4861-9806-11a9845b9f6f-e3f61b03-14e5-4275-83f4-86f7ce1101b8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 7.125s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:42.154488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:42.155388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance network_info: |[{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:13:42.155814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] Acquired lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:42.156133 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Refreshing network info cache for port 8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:42.159813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start _get_guest_xml network_info=[{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:13:42.163491 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:42.165282 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-133651706', uuid='82e032bf-0b06-4188-9792-cc2de6b15ab1'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645622.16467) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:42.167190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:13:42.168541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:13:42.172447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:13:42.172846 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:13:42.176813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:13:42.177638 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:13:42.178295 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:13:42.178538 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:13:42.178788 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:13:42.179053 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:13:42.179356 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:13:42.179751 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:13:42.179986 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:13:42.180226 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:13:42.180438 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:13:42.180676 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:13:42.195796 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133651706',display_name='tempest-ServerRescueNegativeTestJSON-server-133651706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-133651706',id=11,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-8d4yz1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:40Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=82e032bf-0b06-4188-9792-cc2de6b15ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:42.197173 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:42.197173 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:42.197173 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:42.246395 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:13:42.348017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:42.348017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:42.494972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.776s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:42.496941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.184s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:42.586653 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Deleted allocations for instance 30a3c85b-773d-4859-b01e-a751646ff4b1
May 13 04:13:42.630562 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Successfully updated port: 8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:42.661188 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:42.692426 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-changed-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:42.692961 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Refreshing instance network info cache due to event network-changed-8e41bccc-9580-4bc4-b021-122855ecc2a9. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:42.693195 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] Acquiring lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:42.693265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] Acquired lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:42.693418 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Refreshing network info cache for port 8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:42.700066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] End _get_guest_xml xml=<domain type="qemu">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <uuid>82e032bf-0b06-4188-9792-cc2de6b15ab1</uuid>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <name>instance-0000000b</name>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-133651706</nova:name>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:13:42</nova:creationTime>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         <nova:port uuid="8a1a26a8-6c0b-4008-b136-c7a0537572af">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="serial">82e032bf-0b06-4188-9792-cc2de6b15ab1</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="uuid">82e032bf-0b06-4188-9792-cc2de6b15ab1</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:8f:2e:6c"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <target dev="tap8a1a26a8-6c"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/console.log" append="off"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:42.700066 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Preparing to wait for external event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133651706',display_name='tempest-ServerRescueNegativeTestJSON-server-133651706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-133651706',id=11,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-8d4yz1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:40Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=82e032bf-0b06-4188-9792-cc2de6b15ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:42.702830 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:42.705436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.705436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:42.705436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:42.705765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.706047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48d141a0-2742-5f4a-8327-10e2b6644816', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:42.707612 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.711023 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:42.713891 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.714218 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a1a26a8-6c, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:42.714769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a1a26a8-6c, col_values=(('qos', UUID('6cd2b89e-bc2c-4d0c-a569-1c23a741f992')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:42.715536 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a1a26a8-6c, col_values=(('external_ids', {'iface-id': '8a1a26a8-6c0b-4008-b136-c7a0537572af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:2e:6c', 'vm-uuid': '82e032bf-0b06-4188-9792-cc2de6b15ab1'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:42.719049 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.719049 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:42.724392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:42.724864 np0000000669 nova-compute[97951]: INFO os_vif [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c')
May 13 04:13:42.853774 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'flavor' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:42.941792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:42.941982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:42.942191 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:42.942424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:42.942477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:42.946423 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Terminating instance
May 13 04:13:43.046809 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:43.054937 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:43.055192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:43.131915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:43.149121 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:43.149444 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:43.195574 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:43.235422 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updated VIF entry in instance network info cache for port 8a1a26a8-6c0b-4008-b136-c7a0537572af. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:13:43.236456 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:43.252497 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:13:43.253463 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:13:43.253702 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Creating image(s)
May 13 04:13:43.254574 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:43.254843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:43.256091 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.258850 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:43.263574 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:43.266155 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:43.299995 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:43.379561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.113s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:43.380046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:43.381688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:43.382211 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:43.386227 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:43.386622 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:43.453618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:13:43.464355 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:43.466910 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.080s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:43.467770 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:43.481813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:43.505282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:43.508575 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:43.529257 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk 1073741824" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:43.529257 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.529257 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:43.543451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:43.557924 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:13:43.598487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aeebc8c7-38af-429b-9c1d-d0dd72d771b1 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "30a3c85b-773d-4859-b01e-a751646ff4b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.477s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.642728 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-changed-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:43.643554 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing instance network info cache due to event network-changed-37cdbc96-1ec2-42b4-a204-e478fcc3e152. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:43.643741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] Acquiring lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:43.643834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] Acquired lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:43.643960 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Refreshing network info cache for port 37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:43.644703 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:43.645810 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:13:43.645917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:43.661126 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:43.733684 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:43.735630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:43.735841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:43.735976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.736137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:43.736298 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7aa0d15e-9702-46a1-a052-5c58924d1c2b req-f7dd26df-eb58-4709-bb38-63f9a7d42ca9 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:43.739433 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:43.739821 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Cannot resize image /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:13:43.740481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:13:43.740708 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Ensure instance console log exists: /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:13:43.746579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-903438a1-54fa-408e-a92a-aea23ca2538c req-7a7e3ac0-5626-4406-9bba-67500776f238 service nova] Releasing lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:43.746579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:43.746579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:43.746579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.803737 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999702987000092 future=<Future at 0x7a463c7433e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:43.806280 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Instance destroyed successfully.
May 13 04:13:43.807096 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lazy-loading 'resources' on Instance uuid 57380f3d-d29c-4861-9806-11a9845b9f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:43.862729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:43.968897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5fd8d396-b9ce-4e03-8b77-51fa345b2f65 req-9b2709cb-c6cd-48f5-942c-9a0345b7d71d service nova] Releasing lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:43.969456 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:43.970398 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:44.140078 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:44.158405 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:44.177452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.681s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:44.179246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.039s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:44.186399 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:13:44.186399 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Claim successful on node np0000000669
May 13 04:13:44.250782 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:44.251443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:44.251443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:8f:2e:6c, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:44.251774 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Using config drive
May 13 04:13:44.265932 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Deleted allocations for instance 6954b4b1-9bab-4c57-87fa-0dca61e5daf8
May 13 04:13:44.312317 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-196565620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-196565620',id=5,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD043MjLFm9vorX8J8S+aHEvEC/9ezVjLJETQMxVsJOcWhMbxg28mqceYcN9S0DuqXgXba9PuHPXmlpEFt1sZLd7aEELSsxOFD2K+aECdtGtoNJuSL99871ns+KBDu7Mfg==',key_name='tempest-keypair-1636843815',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad8d1e0dd3a4863abd238a6abea29d2',ramdisk_id='',reservation_id='r-tsaq4m2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1597568841',owner_user_name='tempest-TaggedAttachmentsTest-1597568841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a9ed67d1e9a41fcb16cffa5bf1455d7',uuid=57380f3d-d29c-4861-9806-11a9845b9f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:44.312538 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converting VIF {"id": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "address": "fa:16:3e:ee:7b:c2", "network": {"id": "ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-552174331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6ad8d1e0dd3a4863abd238a6abea29d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b063-3e", "ovs_interfaceid": "6047b063-3e9b-46ea-b833-f8ffb140c6a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:44.313181 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:44.313444 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:44.316055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.316559 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6047b063-3e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:44.317989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.319248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:44.324119 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.326553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.326811 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a4278ca-fd82-4be4-89ba-61adb7a9a214) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:44.327630 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.328244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:44.333716 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.337172 np0000000669 nova-compute[97951]: INFO os_vif [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:7b:c2,bridge_name='br-int',has_traffic_filtering=True,id=6047b063-3e9b-46ea-b833-f8ffb140c6a8,network=Network(ba9597de-9fe9-4dd6-a24d-e7b4b1a652d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b063-3e')
May 13 04:13:44.338369 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Deleting instance files /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f_del
May 13 04:13:44.338369 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Deletion of /opt/stack/data/nova/instances/57380f3d-d29c-4861-9806-11a9845b9f6f_del complete
May 13 04:13:44.365970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.531718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:44.578361 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:44.676921 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:44.762219 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:44.825794 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:44.849532 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:13:44.850480 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:13:44.850790 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:13:44.850910 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:13:44.851239 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:44.905415 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updated VIF entry in instance network info cache for port 37cdbc96-1ec2-42b4-a204-e478fcc3e152. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:13:44.905574 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:44.952750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:44.952971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:44.953237 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attaching volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c to /dev/vdb
May 13 04:13:44.979488 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:45.005351 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Creating config drive at /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config
May 13 04:13:45.010044 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:45.012130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp32arwove {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:45.032339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:45.056831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:45.078629 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Updating instance_info_cache with network_info: [{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:45.081315 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp32arwove" returned: 0 in 0.066s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:45.098236 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:45.100283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:45.114475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:45.116501 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:13:45.116649 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:45.116803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:45.117121 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:45.118158 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating existing volume attachment record: f47d6568-8a7f-42c4-ae50-2ea01f6d653c {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:45.289408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0df07d4f-dc63-4227-b332-1aafb9201e50 tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Lock "6954b4b1-9bab-4c57-87fa-0dca61e5daf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.279s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:45.414877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-feb7c9ee-d17b-42a7-b6fe-64870cfb08e2 req-a2a52295-79fb-44fc-bf02-0e8edaee44d5 service nova] Releasing lock "refresh_cache-2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:45.513214 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b477100c-e927-462b-9ab7-f8c3c1033b04 req-ab498510-7483-4089-857e-96b06d88ed27 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-deleted-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:45.513397 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-b477100c-e927-462b-9ab7-f8c3c1033b04 req-ab498510-7483-4089-857e-96b06d88ed27 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Neutron deleted interface 6047b063-3e9b-46ea-b833-f8ffb140c6a8; detaching it from the instance and deleting it from the info cache
May 13 04:13:45.513547 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b477100c-e927-462b-9ab7-f8c3c1033b04 req-ab498510-7483-4089-857e-96b06d88ed27 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:45.583013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:45.583467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance network_info: |[{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:13:45.585392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start _get_guest_xml network_info=[{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:13:45.588040 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:45.589679 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-425798097', uuid='55d556b2-785a-44cd-b996-ff93c203bacc'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645625.5892198) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:45.593347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:13:45.593814 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:13:45.598116 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:13:45.598363 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:13:45.599485 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:13:45.599876 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:13:45.600063 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:13:45.600181 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:13:45.600348 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:13:45.600469 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:13:45.600608 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:13:45.600885 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:13:45.600932 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:13:45.601155 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:13:45.601431 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:13:45.601617 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:13:45.613379 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:45.617248 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425798097',display_name='tempest-ServerRescueNegativeTestJSON-server-425798097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-425798097',id=12,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4pugocaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:42Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=55d556b2-785a-44cd-b996-ff93c203bacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:13:45.617441 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:45.618283 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:45.618781 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:45.641258 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:45.684798 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:13:45.685037 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:45.685166 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:45.685535 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:45.685867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:13:45.706355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:45.707133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:45.707515 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:45.707734 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:45.707916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:45.708118 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:45.726878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:45.726878 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:45.727961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:13:45.727961 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:45.746640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c] added
May 13 04:13:45.746640 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:45.746640 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:45.746640 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:45.746640 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:45.746640 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:45.746640 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:45.747681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c] added
May 13 04:13:45.747681 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:13:45.747681 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:45.747681 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:45.747681 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:13:45.747681 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:13:45.747681 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:45.747911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:45.751210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:13:45.751210 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:45.751538 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:13:45.752455 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:45.752455 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:13:45.777928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:45.781741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:45.781998 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:45.849288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:45.849466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] Acquiring lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:45.849624 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:45.849727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:45.849831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] No waiting events found dispatching network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:45.849953 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a4738442-6646-4e0c-be8b-af7a2d0e000e req-bf9033f0-6f31-4c8f-b060-bbc758d1be8a service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Received event network-vif-unplugged-6047b063-3e9b-46ea-b833-f8ffb140c6a8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:13:45.940377 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:45.987253 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:45.994163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.018752 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b477100c-e927-462b-9ab7-f8c3c1033b04 req-ab498510-7483-4089-857e-96b06d88ed27 service nova] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Detach interface failed, port_id=6047b063-3e9b-46ea-b833-f8ffb140c6a8, reason: Instance 57380f3d-d29c-4861-9806-11a9845b9f6f could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:13:46.019775 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.022440 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.123348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] End _get_guest_xml xml=<domain type="qemu">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <uuid>55d556b2-785a-44cd-b996-ff93c203bacc</uuid>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <name>instance-0000000c</name>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-425798097</nova:name>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:13:45</nova:creationTime>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         <nova:port uuid="8e41bccc-9580-4bc4-b021-122855ecc2a9">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <system>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="serial">55d556b2-785a-44cd-b996-ff93c203bacc</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="uuid">55d556b2-785a-44cd-b996-ff93c203bacc</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </system>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <os>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </os>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <features>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </features>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   <devices>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </disk>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:47:52:02"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <target dev="tap8e41bccc-95"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </interface>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/console.log" append="off"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </serial>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <video>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </video>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </rng>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:   </devices>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]: </domain>
May 13 04:13:46.123348 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Preparing to wait for external event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425798097',display_name='tempest-ServerRescueNegativeTestJSON-server-425798097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-425798097',id=12,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4pugocaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:42Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=55d556b2-785a-44cd-b996-ff93c203bacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:46.125239 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:46.125540 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:13:46.127244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.127244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:46.127244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:13:46.127782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.128052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd965eb2f-b337-56d1-9582-87bed4b7d9e5', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:46.128987 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.129810 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:46.132017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.134734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.134912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e41bccc-95, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:46.135590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e41bccc-95, col_values=(('qos', UUID('67de7a42-3f35-4a10-b411-52ad32e93903')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:46.135590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e41bccc-95, col_values=(('external_ids', {'iface-id': '8e41bccc-9580-4bc4-b021-122855ecc2a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:52:02', 'vm-uuid': '55d556b2-785a-44cd-b996-ff93c203bacc'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:46.137873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.140718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:46.142689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.143610 np0000000669 nova-compute[97951]: INFO os_vif [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95')
May 13 04:13:46.286886 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:46.442274 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Took 1.59 seconds to deallocate network for instance.
May 13 04:13:46.575075 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:46.651438 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645626.6508238, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:46.653091 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Started (Lifecycle Event)
May 13 04:13:46.752872 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:13:46.754113 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:46.767218 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:46.767218 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:13:46.772740 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:13:46.772740 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.783122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.791124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.796463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.619s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:46.797164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.806165 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.806554 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.812862 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.813241 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:46.877150 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260]
May 13 04:13:46.877150 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260] successful.
May 13 04:13:46.877150 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.878506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260]
May 13 04:13:46.878506 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260] successful.
May 13 04:13:46.878506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.893392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.901433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.919347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('8', '-', '-', 0) found on session 26 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:46.919347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:46.923504 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('7', '-', '-', 0) found on session 25 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:13:46.923504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:13:46.939735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 26 and hctl ['8', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:46.977275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:46.977275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:46.977275 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 25 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:46.977275 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:47.159132 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:47.163578 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645627.1632562, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:47.163713 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Paused (Lifecycle Event)
May 13 04:13:47.302983 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:13:47.304563 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:13:47.307490 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:47.307490 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:47.518587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:47.518772 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:47.596117 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:47.596686 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:47.596863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:47.596993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:47.597097 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Processing event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:47.597960 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:47.598250 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:13:47.598484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:47.598662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:47.598718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:47.598812 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:47.598944 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-afd50081-d3cf-4071-ae33-480fdbe6fbfe req-e1d23050-9f4a-4083-a069-c4e4f0b9c025 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state building and task_state spawning.
May 13 04:13:47.604370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:13:47.613543 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance spawned successfully.
May 13 04:13:47.618065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:13:47.670867 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:47.672901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:47.673089 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:47.673225 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:47:52:02, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:47.673773 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Using config drive
May 13 04:13:47.675145 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645627.6749675, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:47.675267 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Resumed (Lifecycle Event)
May 13 04:13:47.701688 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a75d231f2f0f4a12aa29226dc1d306ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c259b2e604721a8cd6997f2d51f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:13:47.804985 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:13:47.940664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 26 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:13:47.940877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:13:48.025550 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:48.126481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.126638 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.127011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.127441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.127669 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.128019 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:48.181558 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:48.183641 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:48.187244 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:48.337853 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully created port: a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:48.351004 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Creating config drive at /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config
May 13 04:13:48.359012 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68iwlpt6 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:48.416359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68iwlpt6" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:48.545500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.590s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:48.622065 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Deleted allocations for instance 57380f3d-d29c-4861-9806-11a9845b9f6f
May 13 04:13:48.634135 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Took 8.07 seconds to spawn the instance on the hypervisor.
May 13 04:13:48.634292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:48.691148 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:13:48.737151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found WWN 330000000a811576c for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:13:48.737751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:48.738050 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '330000000a811576c', 'path': '/dev/dm-0', 'multipath_id': '330000000a811576c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:48.738255 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a811576c', 'path': '/dev/dm-0', 'multipath_id': '330000000a811576c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:13:48.742608 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'flavor' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:48.855988 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully created port: bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:48.945726 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:48.966433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:48.989994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:48.997387 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:49.097391 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:49.125556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:49.125556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:49.150713 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Took 13.83 seconds to build instance.
May 13 04:13:49.251984 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attempting to attach volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:13:49.254604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:   <alias name="ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c"/>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:   <serial>a54ea61d-9bd5-427b-a4f2-f1c454b3df3c</serial>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:49.254604 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:13:49.317636 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:13:49.369786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:49.471756 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-98caf663-0bce-4df1-a465-3b110072de8d req-30303029-9ebd-422f-89d5-22f996a4a68f service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:49.472158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98caf663-0bce-4df1-a465-3b110072de8d req-30303029-9ebd-422f-89d5-22f996a4a68f service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:49.472340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98caf663-0bce-4df1-a465-3b110072de8d req-30303029-9ebd-422f-89d5-22f996a4a68f service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:49.472475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98caf663-0bce-4df1-a465-3b110072de8d req-30303029-9ebd-422f-89d5-22f996a4a68f service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:49.472619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-98caf663-0bce-4df1-a465-3b110072de8d req-30303029-9ebd-422f-89d5-22f996a4a68f service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Processing event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:13:49.631872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d013f64d-b584-4b1c-847d-331c77a300e7 tempest-TaggedAttachmentsTest-1597568841 tempest-TaggedAttachmentsTest-1597568841-project-member] Lock "57380f3d-d29c-4861-9806-11a9845b9f6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.690s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:49.656573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.345s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:49.743468 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully created port: f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:49.831184 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Booting with volume bacb0871-9431-4448-ba44-7623d237012e at /dev/vda
May 13 04:13:49.900456 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:49.913970 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:49.946890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:49.987041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:49.987041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:49.999745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:50.001909 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe47:5202'] 
May 13 04:13:50.002178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:50.002285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:50.002642 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:50.003157 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating existing volume attachment record: 863c3524-662f-47c4-a3fc-64bf1a55b894 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:50.008593 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645630.008026, 55d556b2-785a-44cd-b996-ff93c203bacc => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:50.009509 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:13:50.012223 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Started (Lifecycle Event)
May 13 04:13:50.014906 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:13:50.021647 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance spawned successfully.
May 13 04:13:50.024404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:13:50.316834 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully created port: fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:50.518995 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:50.522808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:50.533259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.533259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.534791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.535110 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.535557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.535864 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:13:50.846133 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully created port: 11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:50.939988 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:50.940111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:50.940205 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:13:50.940307 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:20:6d:f2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:13:51.029974 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:13:51.030170 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645631.0300255, 55d556b2-785a-44cd-b996-ff93c203bacc => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:51.030273 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Paused (Lifecycle Event)
May 13 04:13:51.041958 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Took 7.79 seconds to spawn the instance on the hypervisor.
May 13 04:13:51.042112 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:51.136774 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:51.155594 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:51.538808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:51.541635 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645631.541294, 55d556b2-785a-44cd-b996-ff93c203bacc => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:51.541794 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Resumed (Lifecycle Event)
May 13 04:13:51.555881 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Took 15.25 seconds to build instance.
May 13 04:13:51.571363 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:51.571763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:51.571958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:51.572386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:51.572519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:51.572814 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-25ee5a08-7be5-4a0f-8e42-620225b3beca req-32b6bce9-27f7-4ef9-ad27-b649fa710feb service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received unexpected event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with vm_state active and task_state None.
May 13 04:13:51.652840 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Booting with volume 2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 at /dev/vdb
May 13 04:13:51.685023 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:51.722679 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:51.736554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:51.756995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:51.785496 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:51.785764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:51.793503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:51.795043 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe47:5202'] 
May 13 04:13:51.795197 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:51.795365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:51.795666 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:51.795979 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating existing volume attachment record: 3afeda74-ea63-4a37-ba40-074e03368bd6 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:52.045245 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:52.048962 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:13:52.059533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f432df4d-341a-47fc-8c46-39cb168a0446 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.761s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:52.084349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:52.084349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:52.525438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-13f55141-5d69-4e73-8434-00d735d00603 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.572s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:52.586092 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:13:52.878640 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Rescuing
May 13 04:13:52.881350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:52.881350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:52.881350 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:52.901583 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0030832379998173565 future=<Future at 0x7a463c7a3a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.901809 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.902079 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0036674339999080985 future=<Future at 0x7a463c77e030 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.902344 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0038341189999755443 future=<Future at 0x7a463c77e030 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.902344 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.902344 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.901086077999935 future=<Future at 0x7a463c7433e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.902551 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.9009538760001305 future=<Future at 0x7a463c7433e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:52.905175 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Emitting event <LifecycleEvent: 1778645617.8978992, 6954b4b1-9bab-4c57-87fa-0dca61e5daf8 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:52.905175 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] VM Stopped (Lifecycle Event)
May 13 04:13:52.909088 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Emitting event <LifecycleEvent: 1778645617.8982575, 30a3c85b-773d-4859-b01e-a751646ff4b1 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:52.909088 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] VM Stopped (Lifecycle Event)
May 13 04:13:52.968757 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: 39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:53.078449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:53.079379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-39ba483c-84d3-4d58-b954-bb146bb3ced1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:53.079379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:53.079379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:53.080136 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port 39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:53.175755 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:53.176172 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:53.180627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:13:53.181223 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Claim successful on node np0000000669
May 13 04:13:53.387923 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:53.416943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 6954b4b1-9bab-4c57-87fa-0dca61e5daf8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:53.420316 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 30a3c85b-773d-4859-b01e-a751646ff4b1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:53.449570 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Booting with volume 5f19cde9-a046-4f51-a17a-ae9634df311a at /dev/vdc
May 13 04:13:53.537289 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:53.555752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:53.583590 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:53.588388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:53.636397 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:53.636940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:53.651337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:53.653523 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe47:5202'] 
May 13 04:13:53.653682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:53.654101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:53.654101 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:53.654304 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating existing volume attachment record: d7eea6d4-0adb-418e-8299-da253ac6ffb9 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:53.695404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:53.696101 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-a27f493a-1be2-4677-9033-522c612e83fe. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:53.696877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:53.945144 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:53.950615 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:54.380165 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:54.509881 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: 651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:54.755830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:13:54.756202 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:13:54.773860 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:54.784505 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Rebuilding instance
May 13 04:13:54.811234 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:55.007523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:55.012028 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:55.068863 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Updating instance_info_cache with network_info: [{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:55.176880 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:55.177746 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-651fc391-a28c-43c4-b10b-3c85424f6550. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:55.177746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:55.259462 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:13:55.282475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-df74372c-15e5-4aec-a990-7869bf7e9503 req-cc969cae-e49c-44b1-9ab6-05a0215f77a8 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:55.282475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:55.282475 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:55.570899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-55d556b2-785a-44cd-b996-ff93c203bacc" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:55.741469 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:55.769817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.594s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:55.771406 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:13:55.784747 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:55.830503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:55.830694 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-bbee0585-5bcd-474c-aec6-3a53564ab617. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:55.830897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:55.833541 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:13:55.835663 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:13:55.837548 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Creating image(s)
May 13 04:13:55.839082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:13:55.839910 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Ensure instance console log exists: /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:13:55.840182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:55.840367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:55.840533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:55.917387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:56.050420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:56.084743 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:56.138864 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:56.219753 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:56.225544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:56.280793 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:13:56.281130 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:13:56.281908 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:56.281908 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:56.420672 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999386790000017 future=<Future at 0x7a463c34a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:56.422388 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance destroyed successfully.
May 13 04:13:56.520523 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Detaching volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:13:56.579240 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attempting to driver detach volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c from mountpoint /dev/vdb
May 13 04:13:56.586412 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found disk vdb by alias ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:13:56.587207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Attempting to detach device vdb from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:13:56.587207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <alias name="ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c"/>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <serial>a54ea61d-9bd5-427b-a4f2-f1c454b3df3c</serial>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]: </disk>
May 13 04:13:56.587207 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:13:56.594602 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully detached device vdb from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the persistent domain config.
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:56.597817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:13:56.631863 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '26')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:56.631863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '26')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:56.633866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '25')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:56.635291 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b7380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:56.637060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:13:56.637594 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flush multipath device 330000000a811576c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:13:56.672683 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:56.720359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:13:56.763520 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:13:56.763677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:13:56.768523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:13:56.783950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:13:56.784135 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:56.786175 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:13:56.801588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.848934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260]
May 13 04:13:56.848934 np0000000669 nova-compute[97951]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260] successful.
May 13 04:13:56.848934 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.870514 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:56.872460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.886727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.929950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260]
May 13 04:13:56.929950 np0000000669 nova-compute[97951]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260] successful.
May 13 04:13:56.929950 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.935270 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f077cae41c324b0bac3646dc90ca89a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9bc4b864dd4763813e225868b7d67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:13:56.950885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:13:56.951190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:56.951344 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== disconnect_volume: return (354ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:56.951506 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:57.245720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.249667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.251913 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.274399 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:57.274902 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.294070 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:57.308356 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state active and task_state rebuilding.
May 13 04:13:57.308847 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:57.308847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:57.308847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:57.308847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:57.308951 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:57.309048 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-86b944a6-cdbe-483f-beda-499b1642f5bf req-4632aa64-f9dd-4543-8f3c-aa8d748d9a03 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state active and task_state rebuilding.
May 13 04:13:57.372995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-263d8e13-68cd-492b-a210-1c295a7769e7 req-bc01b5e6-3e90-47fe-a254-57171b627597 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:57.373548 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:57.373818 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port 651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:57.386435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.395358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.543609 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999614545999975 future=<Future at 0x7a463c338b00 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:57.550771 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance destroyed successfully.
May 13 04:13:57.550771 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'numa_topology' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:57.878730 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:57.879128 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:57.973158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:57.975222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:57.975421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:57.975537 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:57.975664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:13:57.977492 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-5e29e093-7c07-417e-9809-4a1c108552cc req-7a4f64f7-c502-4c29-8e6f-fda731219a88 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received unexpected event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with vm_state active and task_state rescuing.
May 13 04:13:57.997095 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Successfully created port: 1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:13:58.052163 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance destroyed successfully.
May 13 04:13:58.056096 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-ServerActionsTestOtherA-server-970309316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:03Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:13:58.056609 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:13:58.058089 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:13:58.058089 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:13:58.063086 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Attempting rescue
May 13 04:13:58.065443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:13:58.065443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:58.065443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9024f22-79, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:58.065941 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:58.066852 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:58.073713 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:13:58.073863 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Creating image(s)
May 13 04:13:58.074583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:58.074751 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:58.075184 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:58.076876 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:58.077059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0c21dce-6bd4-4745-8c2c-ec80b33c520a) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:13:58.077528 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:58.077781 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:58.079835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:13:58.083788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:58.086811 np0000000669 nova-compute[97951]: INFO os_vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79')
May 13 04:13:58.089026 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:13:58.090073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:58.090073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:13:58.090263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:13:58.090869 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:13:58.090999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:13:58.112144 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:58.126359 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:13:58.126794 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:13:58.126794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:13:58.127250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:58.129436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b4720>, {}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Disconnecting from: [] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== disconnect_volume: return (41ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:13:58.131348 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Deleting instance files /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7_del
May 13 04:13:58.132065 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Deletion of /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7_del complete
May 13 04:13:58.314631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:13:58.318374 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:13:58.318374 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Creating image(s)
May 13 04:13:58.318374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:58.318374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:58.318798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:58.319576 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.323791 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.326649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.426049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.427349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:58.428112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:58.429070 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.432921 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.433668 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.533567 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.533567 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.553074 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:58.581761 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:58.583423 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.595556 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.596389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk 1073741824" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.597157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:58.598208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:58.598674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.599993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:58.600277 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.602581 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:13:58.602889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.678906 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:13:58.708247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.710696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.729432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.731641 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:13:58.732118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:58.770026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue" returned: 0 in 0.061s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.772369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:58.772369 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'migration_context' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:58.794634 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Successfully updated port: 1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:58.806744 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.003271835000077772 future=<Future at 0x7a463c7433e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:58.806845 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:58.806972 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.61302364900007 future=<Future at 0x7a463c34a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:58.807089 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.612918267000168 future=<Future at 0x7a463c34a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:13:58.807489 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] Emitting event <LifecycleEvent: 1778645623.8033447, 57380f3d-d29c-4861-9806-11a9845b9f6f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:13:58.807940 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] VM Stopped (Lifecycle Event)
May 13 04:13:58.833192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:13:58.833646 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Cannot resize image /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:13:58.833985 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:13:58.834652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Ensure instance console log exists: /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:13:58.836108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:13:58.836344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:13:58.836569 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:13:59.156198 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Booting with volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c at /dev/vdb
May 13 04:13:59.181599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-989491e3-ed1b-4c1c-87c3-1fc8996fb4eb req-ab52563d-edab-4350-9e87-98fcc284c6e5 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:13:59.182490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:59.182687 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:13:59.223077 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:13:59.240877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:13:59.271006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:13:59.287437 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:59.292923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:13:59.295267 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start _get_guest_xml network_info=[{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:47:52:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:13:59.296270 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:59.299492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:59.299633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:13:59.299775 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:13:59.304562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:13:59.307418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:13:59.314467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-157e9ca7-c83c-4ebd-b875-c07ae4f5e905 tempest-AttachSCSIVolumeTestJSON-134677350 tempest-AttachSCSIVolumeTestJSON-134677350-project-member] [instance: 57380f3d-d29c-4861-9806-11a9845b9f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:13:59.317586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:13:59.319608 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::d896:1ff:fef2:e127'] 
May 13 04:13:59.319743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:13:59.319869 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:13:59.320121 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:13:59.320851 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating existing volume attachment record: 7caa4cdd-63bb-4422-ae35-a589cd999783 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:13:59.381249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:13:59.392586 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:13:59.392737 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-f630024b-f368-4240-a2da-7de17c078e39. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:13:59.392876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:13:59.685185 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:13:59.737678 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Successfully updated port: 11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:13:59.801573 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:13:59.803414 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:13:59.810091 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:13:59.811674 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-425798097', uuid='55d556b2-785a-44cd-b996-ff93c203bacc'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:47:52:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645639.8110933) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:13:59.813854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:13:59.814491 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:13:59.815796 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:13:59.815903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:13:59.816972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:13:59.817271 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:13:59.817430 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:13:59.817531 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:13:59.817934 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:13:59.817934 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:13:59.817934 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:13:59.817934 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:13:59.818125 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:13:59.818125 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:13:59.818205 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:13:59.818380 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:13:59.818507 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:13:59.910039 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:00.009067 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:00.071120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:00.071351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:00.071528 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:00.071648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:00.071782 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:00.072012 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received unexpected event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with vm_state active and task_state rescuing.
May 13 04:14:00.072070 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-changed-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:00.072154 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Refreshing instance network info cache due to event network-changed-1b0d75fc-5391-448b-820c-396c3a386431. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:00.072299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Acquiring lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:00.104258 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:00.236856 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Updating instance_info_cache with network_info: [{"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:00.239435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:00.320619 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:00.332239 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425798097',display_name='tempest-ServerRescueNegativeTestJSON-server-425798097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-425798097',id=12,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:51Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4pugocaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:51Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=55d556b2-785a-44cd-b996-ff93c203bacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:47:52:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:00.332506 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:47:52:02"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:00.333229 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:00.333848 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:00.511255 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff037a0d-8b6d-4ca2-bbb2-7939f607fc0c req-54258a40-9ba7-4f34-a3f2-3b0c94dd19ee service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:00.511818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:00.512070 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:00.740146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:00.740395 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Instance network_info: |[{"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:00.742478 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Start _get_guest_xml network_info=[{"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:00.742824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Acquired lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:00.743420 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Refreshing network info cache for port 1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:00.745042 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:00.746961 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1140428695', uuid='6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645640.7466292) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:00.747813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:00.748188 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:00.748914 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:00.749106 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:00.749940 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:00.750298 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:00.750476 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:00.750599 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:00.751020 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:00.751020 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:00.751020 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:00.751159 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:00.751288 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:00.751430 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:00.751569 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:00.751739 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:00.769814 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1140428695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1140428695',id=14,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-65nvyot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:57Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:00.770001 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:00.770560 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:00.771052 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:00.835709 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:00.837011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <uuid>55d556b2-785a-44cd-b996-ff93c203bacc</uuid>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <name>instance-0000000c</name>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-425798097</nova:name>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:13:59</nova:creationTime>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         <nova:port uuid="8e41bccc-9580-4bc4-b021-122855ecc2a9">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="serial">55d556b2-785a-44cd-b996-ff93c203bacc</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="uuid">55d556b2-785a-44cd-b996-ff93c203bacc</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config.rescue"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:47:52:02"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <target dev="tap8e41bccc-95"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/console.log" append="off"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:00.837011 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:00.840667 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance destroyed successfully.
May 13 04:14:01.016212 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:01.126283 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:01.248062 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:01.275986 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <uuid>6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5</uuid>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <name>instance-0000000e</name>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1140428695</nova:name>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:00</nova:creationTime>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         <nova:port uuid="1b0d75fc-5391-448b-820c-396c3a386431">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="serial">6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="uuid">6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.config"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:6f:07:4b"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <target dev="tap1b0d75fc-53"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/console.log" append="off"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:01.275986 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Preparing to wait for external event network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1140428695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1140428695',id=14,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-65nvyot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:57Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:01.279902 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:01.285622 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:01.286165 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:01.286605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:01.286983 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:01.287989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:01.288166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ba2fb8-d6be-55aa-a164-b0d60b850626', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:01.291121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:01.296771 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:01.300626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:01.300763 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b0d75fc-53, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:01.301180 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b0d75fc-53, col_values=(('qos', UUID('2f569a7a-fc24-43f9-ac68-695719287d79')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:01.301438 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b0d75fc-53, col_values=(('external_ids', {'iface-id': '1b0d75fc-5391-448b-820c-396c3a386431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:07:4b', 'vm-uuid': '6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:01.305167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:01.316116 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:01.317016 np0000000669 nova-compute[97951]: INFO os_vif [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53')
May 13 04:14:01.382517 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:01.444140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:14:01.444622 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating image(s)
May 13 04:14:01.445096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:01.445353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:01.445940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:01.446347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:01.446701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:01.676757 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:01.841343 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Updated VIF entry in instance network info cache for port 1b0d75fc-5391-448b-820c-396c3a386431. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:01.841721 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Updating instance_info_cache with network_info: [{"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:01.886400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:01.886853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:01.887013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:01.887215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:01.887809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:01.887938 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:02.212352 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.215258 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.215647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.316652 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.part --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.317233 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] 592e03e6-ecc4-4529-9aa6-c500693e9d97 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:14:02.317718 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:14:02.318522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.part /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.345356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Releasing lock "refresh_cache-6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:02.345880 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:02.346020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-11142b22-dcac-4d65-9aa2-81ea9d7943c1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:02.346263 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:02.370511 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:02.370651 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:02.370844 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:02.370948 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:47:52:02, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:02.371863 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Using config drive
May 13 04:14:02.392612 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:02.532662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.part /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.converted" returned: 0 in 0.214s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.540770 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.557464 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:02.632470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.632920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.186s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:02.633235 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.637729 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.639614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.749288 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:02.753621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json" returned: 0 in 0.114s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.754037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:02.754657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:02.755071 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.760865 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:02.760865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.851835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.853364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b,backing_fmt=raw /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.877278 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'ec2_ids' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:02.885051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:02.885051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:02.885240 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:6f:07:4b, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:02.885996 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Using config drive
May 13 04:14:02.914118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:02.915297 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b,backing_fmt=raw /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk 1073741824" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:02.915652 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "9ed4c62985772e7b0946289b6f7872267fa8df9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:02.915975 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:02.971544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:03.025549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ed4c62985772e7b0946289b6f7872267fa8df9b --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:03.026168 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:14:03.026713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:03.124853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:03.125267 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Cannot resize image /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:14:03.125807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:03.126367 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Ensure instance console log exists: /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:14:03.126783 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:03.126941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:03.128047 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:03.131270 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start _get_guest_xml network_info=[{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T04:09:35Z,direct_url=<?>,disk_format='qcow2',id=592e03e6-ecc4-4529-9aa6-c500693e9d97,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T04:09:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '53f03b92-4378-4cea-be96-0fa95cecf2d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'serial': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'}, 'disk_bus': 'virtio', 'attachment_id': '7caa4cdd-63bb-4422-ae35-a589cd999783', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:03.135224 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 13 04:14:03.136588 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='592e03e6-ecc4-4529-9aa6-c500693e9d97', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-970309316', uuid='53f03b92-4378-4cea-be96-0fa95cecf2d7'), owner=OwnerMeta(userid='7cffc8fad0694442ad05ced625bbe1ad', username='tempest-ServerActionsTestOtherA-1572513959-project-member', projectid='03c2202127ca4ec4a872d2af2f5e4576', projectname='tempest-ServerActionsTestOtherA-1572513959'), image=ImageMeta(id='592e03e6-ecc4-4529-9aa6-c500693e9d97', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645643.1360242) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:03.140168 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:03.141023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:03.142100 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:03.142100 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:03.142786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:03.142786 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T04:09:35Z,direct_url=<?>,disk_format='qcow2',id=592e03e6-ecc4-4529-9aa6-c500693e9d97,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T04:09:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:03.142923 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:03.142977 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:03.143139 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:03.143253 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:03.143312 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:03.143535 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:03.143659 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:03.143801 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:03.143937 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:03.144090 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:03.146218 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:03.261224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ebb81575-73d0-4d34-9d98-2630ffcff7c7 req-dda99252-789a-4f0f-96e2-0f6576a04464 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:03.262137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:03.262335 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:03.396647 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:03.402570 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:03.405228 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'keypairs' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:03.531668 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Creating config drive at /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.config
May 13 04:14:03.534772 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj266qq6u {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:03.594248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj266qq6u" returned: 0 in 0.059s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:03.662848 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:03.663378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:03.663547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:03.664686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:03.664686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:03.679641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:03.680022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:03.680222 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:03.680837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:03.681879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:03.682079 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:03.694262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:03.694262 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:03.704031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:03.704031 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c] added
May 13 04:14:03.711769 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:03.711769 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:03.711769 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c] added
May 13 04:14:03.722351 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:03.722351 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:03.722351 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:03.908591 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<55d556b2-785a-44cd-b996-ff93c203bacc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:03.912015 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:04.007255 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:04.127521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.163379 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.166429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.261119 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.281760 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Creating config drive at /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config.rescue
May 13 04:14:04.285438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp37yxf2md {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:04.342473 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp37yxf2md" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:04.385533 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.405228 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:04.506608 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.514690 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.519460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.541959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.549218 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.713519 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:04.721472 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:04.728417 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:04.728417 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:04.746532 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:04.746532 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.754749 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be7e3615-e97a-4805-95bd-9ddf91b58633 req-674f8dec-4e2e-4434-a4ea-725a78573ac0 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:04.755402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be7e3615-e97a-4805-95bd-9ddf91b58633 req-674f8dec-4e2e-4434-a4ea-725a78573ac0 service nova] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:04.756911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be7e3615-e97a-4805-95bd-9ddf91b58633 req-674f8dec-4e2e-4434-a4ea-725a78573ac0 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:04.757038 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be7e3615-e97a-4805-95bd-9ddf91b58633 req-674f8dec-4e2e-4434-a4ea-725a78573ac0 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:04.757222 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be7e3615-e97a-4805-95bd-9ddf91b58633 req-674f8dec-4e2e-4434-a4ea-725a78573ac0 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Processing event network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:04.761468 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:04.763650 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.765856 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.790118 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.791111 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.800449 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:04.845792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260]
May 13 04:14:04.845792 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260] successful.
May 13 04:14:04.845792 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.852872 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260]
May 13 04:14:04.852872 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260] successful.
May 13 04:14:04.852872 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.866545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.872286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.895698 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:04.895698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.898800 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:04.899403 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:04.899668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:04.899668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:04.904846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('8', '-', '-', 0) found on session 28 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:04.905155 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:04.905498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('7', '-', '-', 0) found on session 27 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:04.905652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:04.945005 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.945005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 27 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:04.945005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:04.959592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 28 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:04.959592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:04.965775 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:04.967500 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:05.116769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:05.166286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:05.168736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:05.401613 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:05.402920 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645645.4025116, 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:05.403089 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] VM Started (Lifecycle Event)
May 13 04:14:05.409361 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:05.413039 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Instance spawned successfully.
May 13 04:14:05.415532 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:05.584580 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:05.633617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:05.682210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:14:05.909749 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:05.913600 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:05.934692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:05.934873 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:05.935794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:05.936101 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:05.941994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:05.943871 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:06.111885 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:06.244875 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-53875875-c468-42a2-b7d9-6dcf9e8f7987 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:06.303059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:06.418902 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:06.420670 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645646.4202054, 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:06.420777 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] VM Paused (Lifecycle Event)
May 13 04:14:06.451007 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Took 8.14 seconds to spawn the instance on the hypervisor.
May 13 04:14:06.451242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:06.550169 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:06.706095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found WWN 330000000a811576c for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:06.706907 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:06.707151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000a811576c', 'path': '/dev/dm-0', 'multipath_id': '330000000a811576c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:06.707366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a811576c', 'path': '/dev/dm-0', 'multipath_id': '330000000a811576c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:06.927525 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:06.941888 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645646.935862, 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:06.941888 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] VM Resumed (Lifecycle Event)
May 13 04:14:06.966901 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Took 13.87 seconds to build instance.
May 13 04:14:07.223407 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-ServerActionsTestOtherA-server-970309316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:03Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:07.223407 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:07.224562 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:07.228614 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <uuid>53f03b92-4378-4cea-be96-0fa95cecf2d7</uuid>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <name>instance-0000000a</name>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherA-server-970309316</nova:name>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:03</nova:creationTime>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:image uuid="592e03e6-ecc4-4529-9aa6-c500693e9d97">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:user uuid="7cffc8fad0694442ad05ced625bbe1ad">tempest-ServerActionsTestOtherA-1572513959-project-member</nova:user>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:project uuid="03c2202127ca4ec4a872d2af2f5e4576">tempest-ServerActionsTestOtherA-1572513959</nova:project>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="592e03e6-ecc4-4529-9aa6-c500693e9d97"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         <nova:port uuid="e9024f22-79d3-4f7e-acd7-cd0ff360720e">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="serial">53f03b92-4378-4cea-be96-0fa95cecf2d7</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="uuid">53f03b92-4378-4cea-be96-0fa95cecf2d7</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <alias name="ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <serial>a54ea61d-9bd5-427b-a4f2-f1c454b3df3c</serial>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:20:6d:f2"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <target dev="tape9024f22-79"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/console.log" append="off"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:07.228614 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:07.234235 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-ServerActionsTestOtherA-server-970309316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:03Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:07.234235 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:07.234235 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:07.235112 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:07.236078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.236474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:07.236775 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:07.239583 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.239964 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22287cfa-c455-51e1-b025-8823e20a3ce1', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:07.243537 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.244820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:07.250605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.250885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9024f22-79, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:07.251312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9024f22-79, col_values=(('qos', UUID('0d71eebb-4e6d-45d3-9605-a90fac1d0dcd')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:07.251550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9024f22-79, col_values=(('external_ids', {'iface-id': 'e9024f22-79d3-4f7e-acd7-cd0ff360720e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6d:f2', 'vm-uuid': '53f03b92-4378-4cea-be96-0fa95cecf2d7'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:07.252658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.259815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:07.268313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:07.270932 np0000000669 nova-compute[97951]: INFO os_vif [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79')
May 13 04:14:07.444848 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:07.447012 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:07.472764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d0e357b4-926e-434e-bcce-a71673b62f21 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.389s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:07.596458 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:07.596458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:07.596458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:07.602499 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:07.602809 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] No waiting events found dispatching network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:07.603016 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-efa84df7-9b44-4946-a211-51caac712900 req-bd5bbb3e-db72-4f58-b94e-cc59c890ee6d service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received unexpected event network-vif-plugged-1b0d75fc-5391-448b-820c-396c3a386431 for instance with vm_state active and task_state None.
May 13 04:14:07.724563 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:07.950995 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 55d556b2-785a-44cd-b996-ff93c203bacc due to new event <LifecycleEvent: 1778645647.9506269, 55d556b2-785a-44cd-b996-ff93c203bacc => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:14:07.951154 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645647.9506269, 55d556b2-785a-44cd-b996-ff93c203bacc => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:07.951405 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Resumed (Lifecycle Event)
May 13 04:14:08.333001 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:08.455012 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:08.458676 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:08.583861 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:08.804137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:08.804137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:08.804137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:08.804137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:20:6d:f2, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:08.804137 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Using config drive
May 13 04:14:08.923576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:08.961856 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645648.9607143, 55d556b2-785a-44cd-b996-ff93c203bacc => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:08.961856 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Started (Lifecycle Event)
May 13 04:14:09.086209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:09.086661 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance network_info: |[{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:09.087156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:09.087420 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port 11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:09.089822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Start _get_guest_xml network_info=[{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51569bed-8bc3-4c71-97b6-81cf863c0f4c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'serial': 'bacb0871-9431-4448-ba44-7623d237012e'}, 'disk_bus': 'virtio', 'attachment_id': '863c3524-662f-47c4-a3fc-64bf1a55b894', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51569bed-8bc3-4c71-97b6-81cf863c0f4c', 'attached_at': '', 'detached_at': '', 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'serial': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'}, 'disk_bus': 'virtio', 'attachment_id': '3afeda74-ea63-4a37-ba40-074e03368bd6', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51569bed-8bc3-4c71-97b6-81cf863c0f4c', 'attached_at': '', 'detached_at': '', 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'serial': '5f19cde9-a046-4f51-a17a-ae9634df311a'}, 'disk_bus': 'virtio', 'attachment_id': 'd7eea6d4-0adb-418e-8299-da253ac6ffb9', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:09.093707 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:09.095081 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-381971309', uuid='51569bed-8bc3-4c71-97b6-81cf863c0f4c'), owner=OwnerMeta(userid='a75d231f2f0f4a12aa29226dc1d306ba', username='tempest-TaggedBootDevicesTest-458067948-project-member', projectid='4f6c259b2e604721a8cd6997f2d51f08', projectname='tempest-TaggedBootDevicesTest-458067948'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645649.0945494) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:09.100738 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:09.101190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:09.102638 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:09.102845 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:09.103963 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:09.104756 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:09.104969 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:09.105165 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:09.105384 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:09.105501 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:09.105644 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:09.105821 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:09.105954 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:09.106098 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:09.106245 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:09.106410 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:09.130044 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:09.130532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:09.130768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:09.131253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:09.131604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:09.145527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:09.145934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:09.146212 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:09.146662 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:09.147057 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:09.147192 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:09.160974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:09.160974 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:09.167481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:09.167481 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:09.173362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e] added
May 13 04:14:09.173362 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:09.173362 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:09.173362 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:09.173362 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:09.173362 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:09.173362 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:09.173618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:09.173722 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:09.173944 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:09.178719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e] added
May 13 04:14:09.178719 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:09.178719 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:09.178719 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:09.178719 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:09.178719 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:09.178719 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:09.178913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:09.179038 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:09.179183 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:09.307296 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'ec2_ids' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:09.385852 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:09.464625 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:09.466600 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:09.593733 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:09.686553 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:09.812037 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Object Instance<53f03b92-4378-4cea-be96-0fa95cecf2d7> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:09.812037 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'keypairs' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:09.990261 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:10.073879 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Rescuing
May 13 04:14:10.073879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:10.073879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:10.073879 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:10.174397 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:10.179457 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:10.189086 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:10.189086 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.194876 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] instance snapshotting
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:10.197108 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:10.197108 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.203138 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updated VIF entry in instance network info cache for port 11142b22-dcac-4d65-9aa2-81ea9d7943c1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:10.203854 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:10.210158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.218649 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.228230 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.229025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.236843 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.237083 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:10.286117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.40.100,3260]
May 13 04:14:10.286117 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.40.100,3260] successful.
May 13 04:14:10.286117 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.296025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.50.100,3260]
May 13 04:14:10.296025 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.50.100,3260] successful.
May 13 04:14:10.296025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.303214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.311501 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:10.315152 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Object Instance<53f03b92-4378-4cea-be96-0fa95cecf2d7> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:10.319702 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.326630 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:10.326630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.338115 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:10.338715 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:10.338715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:10.339676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:10.340863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:10.341294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:10.352940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:10.352940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:10.364055 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:10.364055 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:10.365981 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Beginning live snapshot process
May 13 04:14:10.431121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:10.431442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:10.503882 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Creating config drive at /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config
May 13 04:14:10.510347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktii1_x4 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:10.575912 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:10.582788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktii1_x4" returned: 0 in 0.072s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:10.713798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0bb50a2c-b4f6-46c2-82e5-b85f268762e5 req-116c5e61-a15b-467e-a1ba-0fcb9873e09c service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:10.937951 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:10.944892 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:14:11.111341 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:11.116154 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:11.141094 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:11.148053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:14:11.254539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:11.257247 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:11.266548 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:11.421131 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0009970289997909276 future=<Future at 0x7a463c34a390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:11.421806 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:11.422178 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1213236009998582 future=<Future at 0x7a463c338b00 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:11.422178 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Emitting event <LifecycleEvent: 1778645636.4199235, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:11.422399 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1208861519999118 future=<Future at 0x7a463c338b00 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:11.422399 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:11.424154 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Stopped (Lifecycle Event)
May 13 04:14:11.516146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:11.516580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:11.519915 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:14:11.520074 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Claim successful on node np0000000669
May 13 04:14:11.614405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:11.882402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:11.927976 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9f0fc3e7-9676-420a-9244-d2c04194b4a6 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:11.980649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:11.984352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:12.050150 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645652.049449, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:12.050934 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:12.051221 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Resumed (Lifecycle Event)
May 13 04:14:12.052970 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:12.060028 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance spawned successfully.
May 13 04:14:12.060414 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:12.080145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:12.083350 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:12.086165 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:12.086993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:12.164752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Found WWN 3300000004b75ede9 for multipath device dm-2 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:12.165503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:12.165793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000004b75ede9', 'path': '/dev/dm-2', 'multipath_id': '3300000004b75ede9'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:12.166022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004b75ede9', 'path': '/dev/dm-2', 'multipath_id': '3300000004b75ede9'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:12.184469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.097s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:12.185467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575.delta 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:12.233102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575.delta 1073741824" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:12.234168 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 04:14:12.253033 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:12.481468 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:14:12.482923 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 04:14:12.518754 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:14:12.521558 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575.delta /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:12.555940 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:12.558581 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:12.567968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.568107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.568422 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.568623 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.568916 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.569346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:12.624830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575.delta /opt/stack/data/nova/instances/snapshots/tmpwj896pme/672e0a4ad53246afb4820db49d5a5575" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:12.626286 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Snapshot extracted, beginning image upload
May 13 04:14:12.672810 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:12.673229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:12.673468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:12.673882 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:12.674189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:12.685964 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:12.686421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:12.686992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:12.687244 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:12.687987 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:12.688597 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:12.705373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:12.705373 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:12.717758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:12.717758 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132] added
May 13 04:14:12.719458 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:12.719458 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:12.719458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:12.719766 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:12.719957 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:12.729254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132] added
May 13 04:14:12.729254 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:12.729254 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:12.729254 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:12.729254 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:12.729254 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:12.729254 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:12.729530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:12.729530 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0423(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:12.729597 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:12.798252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.061690 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 13 04:14:13.061989 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645653.0617895, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:13.062291 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Started (Lifecycle Event)
May 13 04:14:13.075188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:13.093332 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:13.093332 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:13.261637 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.268451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.296766 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.428452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.436921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:13.566899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:13.583538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:13.589470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:13.590934 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance destroyed successfully.
May 13 04:14:13.601543 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:13.609883 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'numa_topology' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:13.720605 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:13.730418 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:13.738486 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:13.738486 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:13.752215 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:13.752215 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.760424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.773297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.788405 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.789099 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.797918 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:13.830903 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:13.830903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:13.832037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:13.832037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:13.832037 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:13.832615 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ffa8cb71-e066-4d55-9163-c61b7b1dd4e2 req-fda2eb15-e3f3-4561-b7ee-a3baec9fc2b9 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received unexpected event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with vm_state rescued and task_state None.
May 13 04:14:13.856039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.50.100,3260]
May 13 04:14:13.856039 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.50.100,3260] successful.
May 13 04:14:13.856039 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.864859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.40.100,3260]
May 13 04:14:13.864859 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.40.100,3260] successful.
May 13 04:14:13.864859 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.877889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.885034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.896729 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.897366 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:13.897366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:13.899254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('15', '-', '-', 0) found on session 31 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:13.899254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:13.914666 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:13.917289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:13.917289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:13.917289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 31 and hctl ['15', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:13.917289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('16', '-', '-', 0) found on session 32 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:13.917507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:13.937036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 32 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:13.937036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:14.092080 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:14.092080 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 04:14:14.100493 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999631447999946 future=<Future at 0x7a46480fc110 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:14.101576 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99913123400006 future=<Future at 0x7a46480fc110 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:14.101576 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998934624999947 future=<Future at 0x7a46480fc110 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:14.112932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.596s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:14.116158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.526s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:14.116464 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:14:14.130047 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97951) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 13 04:14:14.136495 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Attempting rescue
May 13 04:14:14.136775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:14:14.146056 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:14:14.146235 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Creating image(s)
May 13 04:14:14.149160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:14.149443 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:14.150060 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:14.150739 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:14.393494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:14.573408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:14.573871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:14.573871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:14.573871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:14.574177 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:14.574177 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9e7ecc6b-187e-45d2-aa55-f0c762f8507b req-a5035605-f751-436c-81cd-7e9805fe8995 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state active and task_state None.
May 13 04:14:14.590344 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] There are 0 instances to clean {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 04:14:14.592559 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:14.593840 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 04:14:14.634826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:14:14.634826 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:14:14.634826 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:14.634826 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:14.653650 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:14.655382 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:14.659966 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:14.662359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:14.662759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:14.663130 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:14.667302 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:14.667909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:14.747289 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cf2542ae398407abdb47a235f3c8505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e441f4e3754f1692b7d4b86c603ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:14:14.760645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:14.762020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:14.813722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:14.814269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:14.814669 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'migration_context' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:14.916961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 31 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:14.917174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:15.064273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:15.064426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:15.099153 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:15.144706 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:14:15.154417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a336671e-21cd-46fd-aa76-b4d5e6d84c7e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.038s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:15.317929 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:15.318261 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:15.318969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start _get_guest_xml network_info=[{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:8f:2e:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:15.319195 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:15.359120 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Successfully created port: 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:14:15.486700 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Snapshot image upload complete
May 13 04:14:15.486909 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-93917637-bac2-4fc8-8aa6-543940e96d4d tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Took 5.29 seconds to snapshot the instance on the hypervisor.
May 13 04:14:15.568361 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Detaching volume 559a15a3-843d-4a18-9b34-952b883984c9
May 13 04:14:15.600497 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:14:15.634741 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Attempting to driver detach volume 559a15a3-843d-4a18-9b34-952b883984c9 from mountpoint /dev/vdb
May 13 04:14:15.640704 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdb by alias ua-559a15a3-843d-4a18-9b34-952b883984c9 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:14:15.642549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdb by alias ua-559a15a3-843d-4a18-9b34-952b883984c9 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:14:15.642549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Attempting to detach device vdb from instance c230a3ec-2c84-425b-b594-f0c669d01bfe from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:14:15.642549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <alias name="ua-559a15a3-843d-4a18-9b34-952b883984c9"/>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <serial>559a15a3-843d-4a18-9b34-952b883984c9</serial>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]: </disk>
May 13 04:14:15.642549 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:14:15.654296 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:14:15.665153 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdb from instance c230a3ec-2c84-425b-b594-f0c669d01bfe from the persistent domain config.
May 13 04:14:15.665306 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] (1/8): Attempting to detach device vdb with device alias ua-559a15a3-843d-4a18-9b34-952b883984c9 from instance c230a3ec-2c84-425b-b594-f0c669d01bfe from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:14:15.665652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <alias name="ua-559a15a3-843d-4a18-9b34-952b883984c9"/>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <serial>559a15a3-843d-4a18-9b34-952b883984c9</serial>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]: </disk>
May 13 04:14:15.665652 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:14:15.713745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Found WWN 33000000067101a07 for multipath device dm-8 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:15.714173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:15.716370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000067101a07', 'path': '/dev/dm-8', 'multipath_id': '33000000067101a07'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:15.716370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000067101a07', 'path': '/dev/dm-8', 'multipath_id': '33000000067101a07'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:15.823349 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:15.828495 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:15.828495 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-133651706', uuid='82e032bf-0b06-4188-9792-cc2de6b15ab1'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:8f:2e:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645655.827846) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:15.830442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:15.830442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:15.839627 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:15.840385 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:15.840651 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:15.840957 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:15.841212 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:15.841455 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:15.841906 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:15.842242 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:15.966922 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:15.967238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:15.967488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:15.967739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:15.967878 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:15.968061 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-34377c70-10bb-4ea6-b66b-9081b3fac346 req-367f87d2-40ae-4b01-bfde-40f2cb0f241a service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received unexpected event network-vif-plugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with vm_state rescued and task_state None.
May 13 04:14:16.222250 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:16.223962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:16.224188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:16.224999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:16.225080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:16.257985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:16.259056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:16.262742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:16.263522 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:16.264560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:16.265385 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:16.285107 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:16.285107 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:16.286681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:16.286681 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:16.305206 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:16.310157 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a] added
May 13 04:14:16.310157 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:16.310157 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:16.310157 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:16.310157 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:16.310157 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:16.310157 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:16.310440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:16.310606 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:16.311038 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a] added
May 13 04:14:16.311038 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:16.311038 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:16.311038 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:16.311038 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:16.311038 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:16.311038 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:16.311719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:16.311719 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0482(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:16.311719 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:16.311719 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:16.346705 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:16.357287 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133651706',display_name='tempest-ServerRescueNegativeTestJSON-server-133651706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-133651706',id=11,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:48Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-8d4yz1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=82e032bf-0b06-4188-9792-cc2de6b15ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:8f:2e:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:16.357768 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:8f:2e:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:16.360870 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:16.360870 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:16.403990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:16.407600 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:16.407782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:16.407972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:16.408221 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:16.408422 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c51af356-fc01-48e0-b577-8d936f8cb4ab req-edfe7da3-bd27-4d66-9a34-e190e7348499 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state rescuing.
May 13 04:14:16.432761 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645656.4324174, c230a3ec-2c84-425b-b594-f0c669d01bfe => ua-559a15a3-843d-4a18-9b34-952b883984c9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:14:16.435966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-559a15a3-843d-4a18-9b34-952b883984c9 for instance c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:14:16.439970 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdb from instance c230a3ec-2c84-425b-b594-f0c669d01bfe from the live domain config.
May 13 04:14:16.441589 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:14:16.441589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:16.441589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:16.524923 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Successfully updated port: 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:14:16.664752 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating image(s)
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:16.669447 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:16.673596 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:16.679464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:16.712637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:16.713372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:16.713372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:16.713564 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:16.715454 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:16.716052 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-26b302fc-8f23-486b-9399-93a45675271f req-3f8fc9e3-be46-4caa-9146-093db9ca3e30 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received unexpected event network-vif-plugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with vm_state active and task_state None.
May 13 04:14:16.778948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:16.782353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:16.782353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:16.782353 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:16.785733 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:16.786396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:16.861924 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:16.868794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <uuid>82e032bf-0b06-4188-9792-cc2de6b15ab1</uuid>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <name>instance-0000000b</name>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-133651706</nova:name>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:15</nova:creationTime>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         <nova:port uuid="8a1a26a8-6c0b-4008-b136-c7a0537572af">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="serial">82e032bf-0b06-4188-9792-cc2de6b15ab1</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="uuid">82e032bf-0b06-4188-9792-cc2de6b15ab1</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config.rescue"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:8f:2e:6c"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <target dev="tap8a1a26a8-6c"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/console.log" append="off"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:16.868794 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:16.877949 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance destroyed successfully.
May 13 04:14:16.888696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:16.889515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:16.951584 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk 1073741824" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:16.953503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:16.953503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:17.028530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:17.028733 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:17.029001 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:17.055121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:17.055636 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:14:17.055980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:17.149347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:17.149800 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Cannot resize image /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:14:17.150432 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:17.150695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Ensure instance console log exists: /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:14:17.151054 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:17.151286 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:17.151451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:17.257567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:17.312063 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:17.313163 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:17.327811 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:17.327811 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:17.340371 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:17.340371 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.350769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.357652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.375569 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.385902 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.386431 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:17.452585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.50.100,3260]
May 13 04:14:17.452585 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.50.100,3260] successful.
May 13 04:14:17.452585 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.470024 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:17.493441 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:17.494310 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:17.494310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:17.497145 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('21', '-', '-', 0) found on session 33 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:17.497145 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:17.517114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 33 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:17.518372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:17.600716 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:17.601052 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:17.601298 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:17.601697 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.48 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:14:17.625961 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:17.847248 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:18.030891 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:18.083754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:18.083754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing instance network info cache due to event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:18.083754 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:18.216717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:18.217005 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:18.401297 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:18.401484 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:18.401653 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:18.401781 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:8f:2e:6c, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:18.402475 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Using config drive
May 13 04:14:18.459885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.40.100,3260]
May 13 04:14:18.459885 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.40.100,3260] successful.
May 13 04:14:18.459885 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:18.474632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:18.499373 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:18.500005 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.241s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:18.500005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:18.501489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] HCTL ('22', '-', '-', 0) found on session 34 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:18.501621 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:18.507801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:18.508189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:18.508411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:18.508622 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:18.508781 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:18.508981 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fe021d73-2692-461f-9c94-64d11eeae346 req-24502600-3b42-4f4f-8aee-834f6698050b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state rescuing.
May 13 04:14:18.521773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 34 and hctl ['22', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:18.536076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:18.536076 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance network_info: |[{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:18.536076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:18.536076 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:18.540221 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start _get_guest_xml network_info=[{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:18.546758 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:18.548246 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1405985100', uuid='dd0d182d-62d3-4878-8fcb-b987cdbb5e1f'), owner=OwnerMeta(userid='7cf2542ae398407abdb47a235f3c8505', username='tempest-AttachVolumeShelveTestJSON-173127407-project-member', projectid='94e441f4e3754f1692b7d4b86c603ca8', projectname='tempest-AttachVolumeShelveTestJSON-173127407'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645658.5476944) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:18.549457 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:18.554206 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:18.556753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:18.557022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:18.558281 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:18.559705 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:18.559894 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:18.559997 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:18.560175 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:18.560900 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:18.561536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:18.561536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:18.561536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:18.561536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:18.561536 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:18.561675 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:18.576619 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6aeW+RLlxa49ucWhbKppnAmwoxqn9Z/gX2f0477L4JdJYwt1atJsLgRbnVlEwNQfvocn20ezH3rl/geF6DY7T7YvKPadxOz6BFLZSLdHiHXKV2NKEpaIEgEWQb3LxR8A==',key_name='tempest-keypair-792508241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:18.577075 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:18.577280 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:18.577774 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_devices' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:18.721425 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:14:18.905444 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'ec2_ids' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:19.037724 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:19.082027 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <uuid>dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</uuid>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <name>instance-0000000f</name>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1405985100</nova:name>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:18</nova:creationTime>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:user uuid="7cf2542ae398407abdb47a235f3c8505">tempest-AttachVolumeShelveTestJSON-173127407-project-member</nova:user>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:project uuid="94e441f4e3754f1692b7d4b86c603ca8">tempest-AttachVolumeShelveTestJSON-173127407</nova:project>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         <nova:port uuid="7fe4fce9-6847-4bd4-8178-cb1962e7a63d">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="serial">dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="uuid">dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:b1:31:d9"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <target dev="tap7fe4fce9-68"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/console.log" append="off"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:19.082027 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Preparing to wait for external event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6aeW+RLlxa49ucWhbKppnAmwoxqn9Z/gX2f0477L4JdJYwt1atJsLgRbnVlEwNQfvocn20ezH3rl/geF6DY7T7YvKPadxOz6BFLZSLdHiHXKV2NKEpaIEgEWQb3LxR8A==',key_name='tempest-keypair-792508241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:19.084366 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:19.085780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.085780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:19.085780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:19.085780 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:19.086844 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:19.086981 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:14:19.087225 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:14:19.088333 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.088884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4de3db10-8b90-5c7d-bea5-c3369f07fe0c', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:19.092611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.093776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:19.099089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.101961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.102628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fe4fce9-68, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:19.102628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fe4fce9-68, col_values=(('qos', UUID('8078650d-2b54-429d-9729-06fc98edcb06')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:19.102744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fe4fce9-68, col_values=(('external_ids', {'iface-id': '7fe4fce9-6847-4bd4-8178-cb1962e7a63d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:31:d9', 'vm-uuid': 'dd0d182d-62d3-4878-8fcb-b987cdbb5e1f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:19.105070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.107523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:19.116672 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.117519 np0000000669 nova-compute[97951]: INFO os_vif [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68')
May 13 04:14:19.303185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:19.303185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:19.309427 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:14:19.309427 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Claim successful on node np0000000669
May 13 04:14:19.395843 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:19.408346 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:19.410210 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:19.410444 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'keypairs' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:19.519286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Searching for a device in session 34 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:19.519286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:19.545084 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updated VIF entry in instance network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:19.545471 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:19.914698 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:19.917499 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:20.050850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-966cd035-c2b9-43f2-8480-52fa8f20afd1 req-78947097-97e9-4450-9549-3fe02b1afedd service nova] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:20.061521 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Creating config drive at /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config.rescue
May 13 04:14:20.062274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:20.066877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp149ni_d_ {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:20.084929 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:20.085276 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:20.120994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp149ni_d_" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:20.306387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798931 for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:20.306864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.082s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:20.307053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== connect_volume: return (4083ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798931', 'path': '/dev/dm-11', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798931'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:20.307449 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798931', 'path': '/dev/dm-11', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798931'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:20.308056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.866s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:20.308720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '559a15a3-843d-4a18-9b34-952b883984c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:14:20.308974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:20.346705 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:14:20.346705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '24')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:20.349522 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9', '23')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:20.351475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b6840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:14:20.351659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Removing multipathed devices sdd, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:14:20.351930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flush multipath device 330000000cb608bd7 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:14:20.383518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:20.427669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:20.476205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:14:20.476925 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:14:20.484689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:14:20.498961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:14:20.499344 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:14:20.511854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.556773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260]
May 13 04:14:20.556773 np0000000669 nova-compute[97951]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.40.100,3260] successful.
May 13 04:14:20.556773 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.587507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.592647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:20.604088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.642179 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:20.642351 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:20.643133 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No VIF found with MAC fa:16:3e:b1:31:d9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:20.643768 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Using config drive
May 13 04:14:20.653853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260]
May 13 04:14:20.653853 np0000000669 nova-compute[97951]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-559a15a3-843d-4a18-9b34-952b883984c9, portal: 192.168.50.100,3260] successful.
May 13 04:14:20.653853 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.662423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:20.689368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:20.689635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:20.689802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== disconnect_volume: return (4248ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:20.694436 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:14:20.710435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:20.814418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.814669 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.815485 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.817114 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.818344 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.819353 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.820237 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.820481 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.820987 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.825086 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.829375 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.830081 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.830915 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.831116 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.831618 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.832411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.832605 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.833034 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.833667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:20.834173 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:20.834316 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:20.834944 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lazy-loading 'pci_devices' on Instance uuid 51569bed-8bc3-4c71-97b6-81cf863c0f4c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:20.838090 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:20.850250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.008239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:21.008725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.008725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.008725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.009366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:21.009366 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-196f99be-f026-4b1c-8639-8596875b17b7 req-c7fcec10-c645-4dcd-bcbd-c590fb9a2afd service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state rescuing.
May 13 04:14:21.107231 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:21.107587 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:21.156679 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:21.287957 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:21.348079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <uuid>51569bed-8bc3-4c71-97b6-81cf863c0f4c</uuid>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <name>instance-0000000d</name>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:name>tempest-device-tagging-server-381971309</nova:name>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:09</nova:creationTime>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:user uuid="a75d231f2f0f4a12aa29226dc1d306ba">tempest-TaggedBootDevicesTest-458067948-project-member</nova:user>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:project uuid="4f6c259b2e604721a8cd6997f2d51f08">tempest-TaggedBootDevicesTest-458067948</nova:project>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="a27f493a-1be2-4677-9033-522c612e83fe">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="39ba483c-84d3-4d58-b954-bb146bb3ced1">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="651fc391-a28c-43c4-b10b-3c85424f6550">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="bbee0585-5bcd-474c-aec6-3a53564ab617">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="f630024b-f368-4240-a2da-7de17c078e39">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         <nova:port uuid="11142b22-dcac-4d65-9aa2-81ea9d7943c1">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="serial">51569bed-8bc3-4c71-97b6-81cf863c0f4c</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="uuid">51569bed-8bc3-4c71-97b6-81cf863c0f4c</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/disk.config"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <alias name="ua-bacb0871-9431-4448-ba44-7623d237012e"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-2"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <serial>bacb0871-9431-4448-ba44-7623d237012e</serial>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <alias name="ua-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-8"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <serial>2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132</serial>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <alias name="ua-5f19cde9-a046-4f51-a17a-ae9634df311a"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-11"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="vdc" bus="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <serial>5f19cde9-a046-4f51-a17a-ae9634df311a</serial>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d5:a2:17"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tapa27f493a-1b"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:45:30:d0"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tap39ba483c-84"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:88:a3:a5"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tap651fc391-a2"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:8f:f8:52"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tapbbee0585-5b"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:36:b2:00"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tapf630024b-f3"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:2c:bb:21"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tapfb63e16b-32"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:44:d0:51"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <target dev="tap11142b22-dc"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/console.log" append="off"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:21.348079 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:21.353148 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.353148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.353148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.353148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.354087 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.354087 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating config drive at /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config
May 13 04:14:21.354087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.354087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.354177 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.354358 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.354499 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.355052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.355052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.355052 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.355052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.355476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.355476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.355476 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.355476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.355595 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.355710 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.355845 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.355917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.356056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.356169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.356365 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Preparing to wait for external event network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:21.356417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:21.356556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:21.356714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:21.359478 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.359719 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.360231 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.360577 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.363055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.363601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.363846 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.364867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.365054 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '431d1fba-0050-5df6-aaeb-937f1c6e5c84', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.366138 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.366862 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.372588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsuhx1my2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:21.384431 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.400363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.400363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa27f493a-1b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.400363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa27f493a-1b, col_values=(('qos', UUID('7569b01e-2755-45dc-9e67-5541061e749e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.400363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa27f493a-1b, col_values=(('external_ids', {'iface-id': 'a27f493a-1be2-4677-9033-522c612e83fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a2:17', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.402838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.403752 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.416687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.418824 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b')
May 13 04:14:21.420118 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.420386 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.421240 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.422348 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.422348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.422348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.422348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.423499 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.423929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsuhx1my2" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:21.424156 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1e38e0f-b55f-5521-a91e-07aafffeac2f', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.426055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.436264 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.441107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.441107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39ba483c-84, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.441107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39ba483c-84, col_values=(('qos', UUID('8a032e58-71fc-41fb-995d-36669d6d0fc6')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.441107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39ba483c-84, col_values=(('external_ids', {'iface-id': '39ba483c-84d3-4d58-b954-bb146bb3ced1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:30:d0', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.445493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.463614 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.466846 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84')
May 13 04:14:21.467499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.467682 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.468085 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.468278 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.469823 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.470757 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.470757 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.476465 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.476465 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '997d830d-5faf-537c-8f65-5aa2b1e3aefd', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.476689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.477242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.496435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.501939 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.502118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap651fc391-a2, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.503108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap651fc391-a2, col_values=(('qos', UUID('45db9074-09de-4750-af9f-051824bad304')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.503108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap651fc391-a2, col_values=(('external_ids', {'iface-id': '651fc391-a28c-43c4-b10b-3c85424f6550', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:a3:a5', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.506968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.506968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.536977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.538363 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2')
May 13 04:14:21.539190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.539377 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.539936 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.540173 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.540717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.542064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.542229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.543567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.543838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39e917bd-4bdc-555e-ae0a-ebe56d5bce7c', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.544588 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.548347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.572344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.574926 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.575137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbee0585-5b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.575469 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbee0585-5b, col_values=(('qos', UUID('188910d1-b61d-477a-81c6-56e80253401a')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.575602 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbee0585-5b, col_values=(('external_ids', {'iface-id': 'bbee0585-5bcd-474c-aec6-3a53564ab617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:f8:52', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.580177 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.580177 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.605173 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.607762 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b')
May 13 04:14:21.609351 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.609710 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.611365 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.611365 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.616747 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:21.623986 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.628345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.628579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.633556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.633756 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9062bd47-a6d0-5b0d-a668-6d691b299c28', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.634553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.635238 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.669680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.673548 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.674246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf630024b-f3, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.674246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf630024b-f3, col_values=(('qos', UUID('26a91026-2e57-414e-b4ac-0ff306090032')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.674366 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf630024b-f3, col_values=(('external_ids', {'iface-id': 'f630024b-f368-4240-a2da-7de17c078e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:b2:00', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.675401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.679344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.713391 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.714792 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3')
May 13 04:14:21.715997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.716188 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.716864 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.717417 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.718590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.718802 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.718973 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.720366 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.720497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53a8f2f7-0d02-509a-bc21-2ec74938c596', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.721363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.722844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.760558 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.765872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.768435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb63e16b-32, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.768435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb63e16b-32, col_values=(('qos', UUID('fc8835c0-0cad-49c1-b605-11b1ef0638e4')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.768435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb63e16b-32, col_values=(('external_ids', {'iface-id': 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:bb:21', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.772173 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.813342 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.813965 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32')
May 13 04:14:21.814650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:21.814859 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:21.817276 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:21.817276 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:21.817689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.817970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.818185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:21.819506 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.819854 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdbc517b-70fb-5c23-b9e8-4ab41348214d', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.822833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.844221 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 82e032bf-0b06-4188-9792-cc2de6b15ab1 due to new event <LifecycleEvent: 1778645661.8436327, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:14:21.844463 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645661.8436327, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:21.844666 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Resumed (Lifecycle Event)
May 13 04:14:21.855446 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c642ead9-8320-415b-89da-04ce98ac7eaf tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:21.858513 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.865231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.865231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11142b22-dc, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.865231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11142b22-dc, col_values=(('qos', UUID('f0c8f33f-2af8-4266-91de-a2528416e2d3')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.865231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11142b22-dc, col_values=(('external_ids', {'iface-id': '11142b22-dcac-4d65-9aa2-81ea9d7943c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d0:51', 'vm-uuid': '51569bed-8bc3-4c71-97b6-81cf863c0f4c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:21.876639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:21.918382 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:21.918644 np0000000669 nova-compute[97951]: INFO os_vif [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc')
May 13 04:14:22.015061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.089163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.099357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.132147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.829s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:22.133234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:14:22.140588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.543s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:22.140588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:22.143012 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:14:22.153111 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.303925 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2722c106-2145-4554-8442-fc8a7d9fe56b tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.236s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:22.357361 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:22.371764 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:22.487891 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.510855 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c6ee2fe-89a6-4a7d-aca7-06d05d865359 req-142b2598-1809-4cec-a738-b6bff4a23424 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:22.515176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c6ee2fe-89a6-4a7d-aca7-06d05d865359 req-142b2598-1809-4cec-a738-b6bff4a23424 service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:22.515176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c6ee2fe-89a6-4a7d-aca7-06d05d865359 req-142b2598-1809-4cec-a738-b6bff4a23424 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:22.515176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c6ee2fe-89a6-4a7d-aca7-06d05d865359 req-142b2598-1809-4cec-a738-b6bff4a23424 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:22.515376 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c6ee2fe-89a6-4a7d-aca7-06d05d865359 req-142b2598-1809-4cec-a738-b6bff4a23424 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Processing event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:22.528681 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.531616 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.599778 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.640292 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:22.640467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:22.640625 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:22.646625 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97951) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 04:14:22.648112 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:22.653047 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:14:22.653267 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:14:22.653640 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:22.654749 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:22.689697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:22.795689 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f077cae41c324b0bac3646dc90ca89a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9bc4b864dd4763813e225868b7d67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:14:22.878626 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645662.8769755, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:22.882450 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Started (Lifecycle Event)
May 13 04:14:23.136655 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:23.137682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:23.137682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:23.137850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:23.138019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:23.138853 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-198b56e9-a6b2-4e24-bc74-76ec40df6bec req-316da1f5-df08-4688-8d7d-802dcaafe56b service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state rescued and task_state unrescuing.
May 13 04:14:23.158736 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:14:23.263618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.326689 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:23.328046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:23.334087 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:23.340575 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance spawned successfully.
May 13 04:14:23.342284 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:23.384931 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:23.387867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:23.388748 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:23.391760 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.465526 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Successfully created port: 1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:14:23.475524 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:23.475915 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:23.478519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] No VIF found with MAC fa:16:3e:d5:a2:17, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:23.478519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] No VIF found with MAC fa:16:3e:36:b2:00, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:23.478911 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Using config drive
May 13 04:14:23.512761 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:23.517307 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.607427 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Unrescuing
May 13 04:14:23.607748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:23.607918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:23.608104 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:23.633684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:23.636574 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.666554 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:14:23.748349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:23.751722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.794709 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:23.819077 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:23.836540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:23.857841 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.857841 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.858007 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.858440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.858868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.859221 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:23.886944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:23.890411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:23.906831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:23.915704 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:14:23.918486 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645663.916385, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:23.918486 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Started (Lifecycle Event)
May 13 04:14:23.998919 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:24.008761 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.009483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:24.020270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.075601 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance destroyed successfully.
May 13 04:14:24.078117 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'numa_topology' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:24.114232 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:24.148393 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.152377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.197288 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Booting with blank volume at /dev/vda
May 13 04:14:24.274513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk.rescue --force-share --output=json" returned: 0 in 0.124s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.274513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.319992 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Creating config drive at /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/disk.config
May 13 04:14:24.349371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5hdcjd7 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.381308 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Took 7.72 seconds to spawn the instance on the hypervisor.
May 13 04:14:24.381979 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:24.399801 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:24.417422 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.417422 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5hdcjd7" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.417422 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.442476 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:24.457172 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:24.556238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.562499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:24.562499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:24.562499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:24.573181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.602604 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:24.603826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:24.640237 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Successfully updated port: 1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:14:24.714006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.716968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:24.808752 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:24.877301 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:24.906496 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Took 13.45 seconds to build instance.
May 13 04:14:24.963318 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:24.963318 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:24.963489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:24.963656 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:24.968422 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645664.964435, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:24.968422 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:24.968783 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received unexpected event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with vm_state active and task_state None.
May 13 04:14:24.968924 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Paused (Lifecycle Event)
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:24.972707 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-5cc603d1-6f66-4576-b374-f5ecf3fe74c2 req-01f24c70-623a-4060-b717-b9f89bad4cb1 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state None.
May 13 04:14:25.095901 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [{"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:25.108936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.150832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2000d589-2255-4cd7-a6ff-decbe9719073 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:25.155104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:25.155104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:25.155104 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:25.177380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.273076 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.404787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.413627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.982s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:25.415603 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.477263 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:25.479721 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645665.4793792, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:25.479809 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Resumed (Lifecycle Event)
May 13 04:14:25.531297 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.582562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.584593 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.603662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-82e032bf-0b06-4188-9792-cc2de6b15ab1" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:25.603662 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'flavor' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:25.644887 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.675442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.682848 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.732474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.783252 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-522dd423-8146-4974-8a28-f3da1451cd88 req-2ac7714e-4df8-45bd-92aa-ab3657b8c78c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:25.783252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-522dd423-8146-4974-8a28-f3da1451cd88 req-2ac7714e-4df8-45bd-92aa-ab3657b8c78c service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:25.783474 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-522dd423-8146-4974-8a28-f3da1451cd88 req-2ac7714e-4df8-45bd-92aa-ab3657b8c78c service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:25.783516 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-522dd423-8146-4974-8a28-f3da1451cd88 req-2ac7714e-4df8-45bd-92aa-ab3657b8c78c service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:25.783627 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-522dd423-8146-4974-8a28-f3da1451cd88 req-2ac7714e-4df8-45bd-92aa-ab3657b8c78c service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:25.784246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.869429 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:25.876405 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.913053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.918903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:25.986093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:25.987987 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:26.122411 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.224283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.233659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.250662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.278751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.287984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.322670 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.322670 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.372058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:26.372058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:26.387001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.400026 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.407746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.435728 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.442256 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:26.449598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.465478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.494501 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999628062000056 future=<Future at 0x7a463c136300 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:26.555442 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:26.584261 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999749563000023 future=<Future at 0x7a463c7b0ce0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:26.586752 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance destroyed successfully.
May 13 04:14:26.587736 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'numa_topology' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:26.648981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:26.648981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:26.648981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:14:26.651477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:26.754440 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.758130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:26.761486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:26.777280 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.828144 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:26.865910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.876229 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:14:26.893818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:26.894827 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:26.919019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:26.919019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing instance network info cache due to event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:26.919019 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:26.919019 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:26.919196 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:26.968590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.980533 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:26.997053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:26.997651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:27.051392 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-changed-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:27.051392 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Refreshing instance network info cache due to event network-changed-1e2d911e-b54e-409e-a93c-5cc61bf9915f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:27.051571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:27.060484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:27.060484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquired lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:27.060484 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:27.060484 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'info_cache' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:27.091206 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<82e032bf-0b06-4188-9792-cc2de6b15ab1> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:27.105348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:27.105942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:27.144003 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.155578 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.207248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:27.207808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:27.331367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:27.338448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:27.338448 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance network_info: |[{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:27.338448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquired lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:27.338448 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Refreshing network info cache for port 1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:27.340935 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:27.341742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:27.391063 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:27.394130 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12694MB free_disk=74.51780319213867GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:14:27.394276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:27.394515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:27.426580 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:27.467041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:27.510956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.522437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.526181 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.553894 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.563370 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:27.568117 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.618930 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.659090 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.685693 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645667.685209, 51569bed-8bc3-4c71-97b6-81cf863c0f4c => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:27.685857 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] VM Started (Lifecycle Event)
May 13 04:14:27.761547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.843030 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:27.905791 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:27.930061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:27.983834 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:27.999435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:14:28.045686 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:28.071296 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:28.082166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:14:28.083083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:14:28.096103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:14:28.100418 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::fc16:3eff:fed0:6485', 'fe80::6868:d5ff:fe74:1a20', 'fe80::fc16:3eff:fe8e:817a', 'fe80::fc16:3eff:fe84:20c7', 'fe80::fc16:3eff:fe6e:5c74', 'fe80::fc16:3eff:febe:1c52', 'fe80::48cb:caff:fe5d:55ad', 'fe80::fc16:3eff:fe62:c74', 'fe80::fc16:3eff:fe86:a766', 'fe80::449d:cdff:fe2f:c6e6', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe20:6df2', 'fe80::fc16:3eff:feb1:31d9', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fed5:a217', 'fe80::fc16:3eff:fe45:30d0', 'fe80::6843:efff:fe61:53aa', 'fe80::fc16:3eff:fe88:a3a5', 'fe80::fc16:3eff:fe8f:f852', 'fe80::fc16:3eff:fe36:b200', 'fe80::6c4d:54ff:fe4a:dcb4', 'fe80::fc16:3eff:fe2c:bb21', 'fe80::fc16:3eff:fe44:d051', 'fe80::c844:73ff:fe0e:1057', 'fe80::fc16:3eff:fe8f:2e6c'] 
May 13 04:14:28.102238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:14:28.102238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:14:28.102238 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:28.102238 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating existing volume attachment record: 27c0c295-f2e7-4305-819f-f5b7c0cfc309 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:14:28.145247 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:28.146166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:28.146365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:28.146365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:28.146619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 in dict_keys([('network-vif-plugged', 'a27f493a-1be2-4677-9033-522c612e83fe'), ('network-vif-plugged', '39ba483c-84d3-4d58-b954-bb146bb3ced1'), ('network-vif-plugged', 'bbee0585-5bcd-474c-aec6-3a53564ab617'), ('network-vif-plugged', 'f630024b-f368-4240-a2da-7de17c078e39'), ('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6'), ('network-vif-plugged', '11142b22-dcac-4d65-9aa2-81ea9d7943c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:28.146619 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-651fc391-a28c-43c4-b10b-3c85424f6550 for instance with vm_state building and task_state spawning.
May 13 04:14:28.146831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:28.147796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:28.147988 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 in dict_keys([('network-vif-plugged', 'a27f493a-1be2-4677-9033-522c612e83fe'), ('network-vif-plugged', '39ba483c-84d3-4d58-b954-bb146bb3ced1'), ('network-vif-plugged', 'bbee0585-5bcd-474c-aec6-3a53564ab617'), ('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6'), ('network-vif-plugged', '11142b22-dcac-4d65-9aa2-81ea9d7943c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:28.147988 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-de2cc93c-1c33-4041-81f8-51a29dd6f1f5 req-dcdd9c76-588a-43b7-9a35-60f363b8181d service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-f630024b-f368-4240-a2da-7de17c078e39 for instance with vm_state building and task_state spawning.
May 13 04:14:28.150512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:28.156163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:28.188370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:28.200268 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645668.1997795, 51569bed-8bc3-4c71-97b6-81cf863c0f4c => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:28.200385 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] VM Paused (Lifecycle Event)
May 13 04:14:28.214075 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updated VIF entry in instance network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:28.214496 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:28.301962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:28.310387 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:28.358172 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:28.528638 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:28.534812 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updated VIF entry in instance network info cache for port 1e2d911e-b54e-409e-a93c-5cc61bf9915f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:28.535109 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:28.543083 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543187 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c230a3ec-2c84-425b-b594-f0c669d01bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543273 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543382 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543497 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 82e032bf-0b06-4188-9792-cc2de6b15ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543586 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 55d556b2-785a-44cd-b996-ff93c203bacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543664 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 51569bed-8bc3-4c71-97b6-81cf863c0f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543740 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543818 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.543910 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f780fcc0-01e6-461f-868d-1dddd9fbc1b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:14:28.696019 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:28.706900 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:28.708694 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:28.717542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-840181bb-9c01-4b5d-96eb-0961ba67817f req-b5de368c-0ef5-42ae-a61f-f1b1ee5b9f15 service nova] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:28.754250 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cf5db013-c707-4a3c-abd3-9d7c812d1359 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:29.037197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Releasing lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:29.037404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.037671 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.037809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.037905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.038008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:29.038122 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:14:29.038233 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.038417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.038562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.038706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.038816 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:29.039003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.039295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.039466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.039597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.039727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe in dict_keys([('network-vif-plugged', '39ba483c-84d3-4d58-b954-bb146bb3ced1'), ('network-vif-plugged', 'bbee0585-5bcd-474c-aec6-3a53564ab617'), ('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6'), ('network-vif-plugged', '11142b22-dcac-4d65-9aa2-81ea9d7943c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:29.039879 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-a27f493a-1be2-4677-9033-522c612e83fe for instance with vm_state building and task_state spawning.
May 13 04:14:29.040000 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.040072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.040188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.040280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.040434 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:29.040691 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.040796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.040948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.041089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.041405 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 in dict_keys([('network-vif-plugged', 'bbee0585-5bcd-474c-aec6-3a53564ab617'), ('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6'), ('network-vif-plugged', '11142b22-dcac-4d65-9aa2-81ea9d7943c1')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:29.041573 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 for instance with vm_state building and task_state spawning.
May 13 04:14:29.041676 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.041816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.041955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.042046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.042144 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad68c80e-fad5-43aa-9273-e2610b792a61 req-db1c334a-ef3f-471e-a365-92ca336f6d9f service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:29.046444 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2737dcc6-03f8-4134-962a-8caa1a9eebae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 04:14:29.046671 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:14:29.046821 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:14:27 up 28 min,  2 users,  load average: 9.21, 4.90, 2.31\n', 'num_instances': '10', 'num_vm_active': '5', 'num_task_None': '6', 'num_os_type_None': '10', 'num_proj_03c2202127ca4ec4a872d2af2f5e4576': '2', 'io_workload': '2', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_32f6190e477e45ffb44a9f7754ab6965': '1', 'num_proj_3c9f82df01ea4b71bca6616768a403f5': '1', 'num_vm_rescued': '2', 'num_task_unrescuing': '1', 'num_proj_5dd34c67006f4acc8b1a4ffc4bb599c1': '2', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_4f6c259b2e604721a8cd6997f2d51f08': '1', 'num_proj_6a9bc4b864dd4763813e225868b7d67c': '2', 'num_proj_94e441f4e3754f1692b7d4b86c603ca8': '1', 'num_task_block_device_mapping': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:14:29.101975 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0008567909999328549 future=<Future at 0x7a46480fc110 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:29.101975 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:29.101975 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.392259677000084 future=<Future at 0x7a463c136300 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:29.101975 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.39218169500009 future=<Future at 0x7a463c136300 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:29.125190 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.127756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.127756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.127756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.127756 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 in dict_keys([('network-vif-plugged', 'bbee0585-5bcd-474c-aec6-3a53564ab617'), ('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:29.127756 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0b599358-3228-4e72-acef-32b2b0c42b9b req-14bc8eae-0b71-44cb-bff5-ee512b556a66 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 for instance with vm_state building and task_state spawning.
May 13 04:14:29.198550 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Releasing lock "refresh_cache-c230a3ec-2c84-425b-b594-f0c669d01bfe" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:29.211996 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:29.213052 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 82e032bf-0b06-4188-9792-cc2de6b15ab1 due to new event <LifecycleEvent: 1778645669.2121058, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:14:29.213225 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645669.2121058, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:29.213407 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Resumed (Lifecycle Event)
May 13 04:14:29.404631 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:29.669281 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-30ec6a7c-153f-4109-8877-fa1c33f0c3a0 req-7d3fdd4b-9526-4f1e-be83-cf346f65d618 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state building and task_state block_device_mapping.
May 13 04:14:29.717062 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:29.719381 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:29.736869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:29.737154 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:30.208706 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance destroyed successfully.
May 13 04:14:30.209169 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'numa_topology' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:30.223644 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645670.2232485, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:30.223903 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Started (Lifecycle Event)
May 13 04:14:30.242333 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:30.263283 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:14:30.265753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:14:30.265753 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Creating image(s)
May 13 04:14:30.265897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:14:30.266037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Ensure instance console log exists: /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:14:30.266466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:30.266690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:30.267143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:30.268056 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start _get_guest_xml network_info=[{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f780fcc0-01e6-461f-868d-1dddd9fbc1b4', 'attached_at': '', 'detached_at': '', 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'serial': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d'}, 'disk_bus': 'virtio', 'attachment_id': '27c0c295-f2e7-4305-819f-f5b7c0cfc309', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:30.271513 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:30.273411 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156', uuid='f780fcc0-01e6-461f-868d-1dddd9fbc1b4'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645670.2725883) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:30.275583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:30.275937 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:30.276831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:30.277759 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:30.280489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:30.280985 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:30.297226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:30.297865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:30.298031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:30.299452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:30.299987 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:30.318485 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:30.318839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:30.320257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:30.322112 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:30.322877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:30.323157 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:30.343492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:30.343492 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:30.353072 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:14:30.353072 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d] added
May 13 04:14:30.357656 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:30.357656 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:30.357656 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:30.367583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d] added
May 13 04:14:30.367583 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:14:30.367583 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:30.367583 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:30.367583 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:14:30.367583 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:14:30.367583 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:30.368076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:14:30.368375 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0452(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:14:30.368584 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:14:30.711010 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:30.711604 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'resources' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:30.727223 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:30.728444 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:30.749649 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:14:30.749853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.355s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:30.750048 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:14:30.750509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.284s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:30.754032 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:14:30.754177 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Claim successful on node np0000000669
May 13 04:14:31.214175 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:31.214946 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:31.215136 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:31.215772 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:31.216001 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:31.218073 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.218383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0bec8c6-18, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:31.219760 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.220674 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:31.223539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.224803 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.224803 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39b7aec6-68eb-4270-be80-9198c5aa8b64) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:31.225584 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.226141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:31.229727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:31.235301 np0000000669 nova-compute[97951]: INFO os_vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:14:31.239790 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start _get_guest_xml network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:31.241031 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:31.242140 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-678076492', uuid='c230a3ec-2c84-425b-b594-f0c669d01bfe'), owner=OwnerMeta(userid='3f4d2a3b569e43219b9d28dfb3990758', username='tempest-AttachVolumeTestJSON-1777051046-project-member', projectid='32f6190e477e45ffb44a9f7754ab6965', projectname='tempest-AttachVolumeTestJSON-1777051046'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645671.2417672) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:31.243050 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:31.243432 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:31.244390 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:31.244634 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:31.245314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:31.245876 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:31.245876 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:31.245979 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:31.246189 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:31.246295 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:31.246454 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:31.246602 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:31.246718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:31.246903 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:31.247062 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:31.247246 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:31.247458 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'vcpu_model' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:31.358094 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:31.369058 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:31.381034 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:31.381034 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:31.388652 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:31.388652 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.395596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.406847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.421019 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.430564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:31.482592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.40.100,3260]
May 13 04:14:31.482592 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.40.100,3260] successful.
May 13 04:14:31.482592 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.487561 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.50.100,3260]
May 13 04:14:31.487561 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.50.100,3260] successful.
May 13 04:14:31.487561 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.498015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.503010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.524130 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.524708 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:31.525176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:31.525176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:31.528139 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:31.529289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:31.529289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:31.529289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('9', '-', '-', 0) found on session 35 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:31.529437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:31.533311 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('10', '-', '-', 0) found on session 36 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:31.533311 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:31.565206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:31.565206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:31.565206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 36 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:31.565206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:31.750171 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:31.757811 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:14:31.761544 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.32 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:14:31.781363 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:31.781363 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:31.781363 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:31.781363 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'pci_devices' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:31.800867 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.801646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.801912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.802959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.803291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:31.803558 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.804704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.806673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.807818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.808245 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No event matching network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 in dict_keys([('network-vif-plugged', 'fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:14:31.809304 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-bbee0585-5bcd-474c-aec6-3a53564ab617 for instance with vm_state building and task_state spawning.
May 13 04:14:31.811289 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.814049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.814685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.814879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.815064 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:31.815225 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state None.
May 13 04:14:31.815574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.815773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.815813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.816044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.816090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:31.816218 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state None.
May 13 04:14:31.816405 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.817620 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.817806 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.817953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.818107 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Processing event network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:31.818281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.818512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.818677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.819875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.820210 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance event wait completed in 4 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:31.820513 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:31.821334 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received unexpected event network-vif-plugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 for instance with vm_state building and task_state spawning.
May 13 04:14:31.821518 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.822244 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.827591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.828143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.828442 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:31.828575 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state None.
May 13 04:14:31.829515 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:31.829515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:31.830439 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:31.830682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:31.831051 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:31.831185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:31.831596 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645671.8296955, 51569bed-8bc3-4c71-97b6-81cf863c0f4c => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:31.831930 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-55354754-b445-4b20-88b2-de0fdd6381d6 req-9c5ec62e-b261-436b-9949-0ddee94307b4 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received unexpected event network-vif-plugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with vm_state active and task_state None.
May 13 04:14:31.832257 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] VM Resumed (Lifecycle Event)
May 13 04:14:31.840500 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance spawned successfully.
May 13 04:14:31.842810 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:32.285473 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:32.286405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <uuid>c230a3ec-2c84-425b-b594-f0c669d01bfe</uuid>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <name>instance-00000008</name>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeTestJSON-server-678076492</nova:name>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:31</nova:creationTime>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:user uuid="3f4d2a3b569e43219b9d28dfb3990758">tempest-AttachVolumeTestJSON-1777051046-project-member</nova:user>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:project uuid="32f6190e477e45ffb44a9f7754ab6965">tempest-AttachVolumeTestJSON-1777051046</nova:project>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         <nova:port uuid="c0bec8c6-18c9-46f2-87ef-63d20e48e115">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="serial">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="uuid">c230a3ec-2c84-425b-b594-f0c669d01bfe</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk.config"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:35:ec:76"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <target dev="tapc0bec8c6-18"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/console.log" append="off"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:32.286405 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:32.290959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:32.325068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:14:32.341118 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:32.344958 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:32.359720 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.359720 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.360403 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.360403 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.361498 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.361973 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:32.405514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:32.406792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:32.522452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:32.523650 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'trusted_certs' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:32.560690 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:32.561070 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:32.852140 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:32.872825 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Took 37.04 seconds to spawn the instance on the hypervisor.
May 13 04:14:32.873550 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:33.026026 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:33.026374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:33.068039 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:33.127140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.101s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:33.128031 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:14:33.128657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:33.231148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:33.232521 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Cannot resize image /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:14:33.232895 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'migration_context' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:33.342720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Found WWN 33000000053f91692 for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:33.343880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:33.344615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000053f91692', 'path': '/dev/dm-1', 'multipath_id': '33000000053f91692'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:33.345388 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053f91692', 'path': '/dev/dm-1', 'multipath_id': '33000000053f91692'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:33.397576 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Took 49.33 seconds to build instance.
May 13 04:14:33.582427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.830s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:33.582427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:14:33.737899 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Object Instance<c230a3ec-2c84-425b-b594-f0c669d01bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:33.738712 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:33.738865 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:33.742932 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:33.743377 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:33.744553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.744553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:33.744553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:33.747058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.748020 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfdc17cb-c158-5830-b03d-36b63cc1bb19', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:33.749570 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.750563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:33.751214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.757658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.757658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0bec8c6-18, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:33.757658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0bec8c6-18, col_values=(('qos', UUID('7329c333-51ec-490c-ac2f-affec9376815')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:33.757658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0bec8c6-18, col_values=(('external_ids', {'iface-id': 'c0bec8c6-18c9-46f2-87ef-63d20e48e115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ec:76', 'vm-uuid': 'c230a3ec-2c84-425b-b594-f0c669d01bfe'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:33.758088 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.759835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:33.766638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:33.769049 np0000000669 nova-compute[97951]: INFO os_vif [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:14:33.805202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:33.805643 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:33.854415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1148087156',id=16,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-7lnb0o68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:24Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=f780fcc0-01e6-461f-868d-1dddd9fbc1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:33.854415 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:33.854415 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:33.857263 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:33.901494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b80245b3-6ba4-4fda-bd9d-55c3936f6d50 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.846s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:34.090391 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:14:34.090391 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:14:34.090884 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:34.091011 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:34.193028 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39f4dddbce124088851b259c812de432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27177d2f7179467fbb0e8e2cfe34c105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:14:34.310599 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:14:34.334720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.362574 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <uuid>f780fcc0-01e6-461f-868d-1dddd9fbc1b4</uuid>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <name>instance-00000010</name>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1148087156</nova:name>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:30</nova:creationTime>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         <nova:port uuid="1e2d911e-b54e-409e-a93c-5cc61bf9915f">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="serial">f780fcc0-01e6-461f-868d-1dddd9fbc1b4</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="uuid">f780fcc0-01e6-461f-868d-1dddd9fbc1b4</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <alias name="ua-0c9695ea-3162-4bb1-9e88-6f01e293ac6d"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-1"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <serial>0c9695ea-3162-4bb1-9e88-6f01e293ac6d</serial>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:90:a5:22"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <target dev="tap1e2d911e-b5"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/console.log" append="off"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:34.362574 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Preparing to wait for external event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1148087156',id=16,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-7lnb0o68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:24Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=f780fcc0-01e6-461f-868d-1dddd9fbc1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.368689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.370783 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:34.370783 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:34.373504 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.373849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5bd9fba-70fa-5961-93ba-3e3f61e1e739', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:34.378528 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.381365 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:34.389550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.389790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e2d911e-b5, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:34.390200 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e2d911e-b5, col_values=(('qos', UUID('c7c09e89-412d-4579-88f2-fba46db9b31b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:34.390436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e2d911e-b5, col_values=(('external_ids', {'iface-id': '1e2d911e-b54e-409e-a93c-5cc61bf9915f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:a5:22', 'vm-uuid': 'f780fcc0-01e6-461f-868d-1dddd9fbc1b4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:34.394384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.397151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:34.402240 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.403730 np0000000669 nova-compute[97951]: INFO os_vif [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5')
May 13 04:14:34.411025 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.532977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.601638 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:14:34.914103 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.926790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:34.965503 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:35.107787 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-changed-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:35.110837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing instance network info cache due to event network-changed-a27f493a-1be2-4677-9033-522c612e83fe. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:35.127765 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:14:35.131373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] Acquiring lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:35.131373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] Acquired lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:35.135819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:35.136937 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Refreshing network info cache for port a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:35.139093 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Successfully created port: ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:14:35.147839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.013s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:35.154034 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:14:35.154152 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Claim successful on node np0000000669
May 13 04:14:35.162693 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:35.162693 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:35.164962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:35.164962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:35.164962 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:35.169592 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0213ad5e-9712-47f9-98f9-70ece7da73fc req-e96724e0-141b-46f1-9bde-2126d1de3538 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:14:35.521015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:35.521138 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:35.521366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:35.521532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:35.521645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:35.524465 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Terminating instance
May 13 04:14:35.650733 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:35.692022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for c230a3ec-2c84-425b-b594-f0c669d01bfe due to new event <LifecycleEvent: 1778645675.6916826, c230a3ec-2c84-425b-b594-f0c669d01bfe => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:14:35.692212 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645675.6916826, c230a3ec-2c84-425b-b594-f0c669d01bfe => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:35.692337 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Resumed (Lifecycle Event)
May 13 04:14:35.693420 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:35.702469 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance rebooted successfully.
May 13 04:14:35.889486 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Successfully updated port: ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:14:35.947817 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-changed-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:35.948757 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Refreshing instance network info cache due to event network-changed-ceadcc43-956a-4c2f-9230-07676ad1cee1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:35.948757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] Acquiring lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:35.948757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] Acquired lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:35.948757 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Refreshing network info cache for port ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:35.968218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:35.968433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:35.968579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:90:a5:22, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:35.969015 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Using config drive
May 13 04:14:36.034993 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:14:36.069662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.075201 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.103178 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:36.115154 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.142425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.158913 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:14:36.159808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:14:36.159808 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Creating image(s)
May 13 04:14:36.162064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:36.162064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:36.162064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:36.163356 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:36.164595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.184924 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.191569 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:36.197563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:36.257984 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:36.285306 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.296980 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:36.367842 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Refreshing inventories for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 04:14:36.375056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.180s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:36.375623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:36.377264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:36.379917 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:36.393693 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.397596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:36.401137 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:36.403095 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:36.460763 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:36.480017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.490108 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:36.502752 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Updating ProviderTree inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 04:14:36.506481 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:14:36.537421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.542461 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updated VIF entry in instance network info cache for port a27f493a-1be2-4677-9033-522c612e83fe. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:36.543815 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [{"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:36.553684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.577953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.175s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:36.579819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:36.667520 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Refreshing aggregate associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, aggregates: None {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 04:14:36.684110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.692009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk 1073741824" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:36.694231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:36.694231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:36.738549 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.812290 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:14:36.812290 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645676.8112566, c230a3ec-2c84-425b-b594-f0c669d01bfe => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:36.812290 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Started (Lifecycle Event)
May 13 04:14:36.818474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:36.829001 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Instance destroyed successfully.
May 13 04:14:36.834533 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lazy-loading 'resources' on Instance uuid 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:36.856873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.163s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:36.858475 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:14:36.858475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:36.982586 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:36.984090 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Refreshing trait associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_ICH9,HW_ARCH_X86_64,HW_CPU_X86_SSE,COMPUTE_ARCH_X86_64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ARCH_PPC64LE,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 04:14:36.993614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:36.994970 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Cannot resize image /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:14:36.996596 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:36.996780 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Ensure instance console log exists: /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:14:36.997404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:36.997404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:36.997569 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:37.047036 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06ba0fe4-21be-4ec0-a2a3-efb83df4fcdd req-38fba3c5-46b0-4997-82c2-a9a108cbc3e2 service nova] Releasing lock "refresh_cache-51569bed-8bc3-4c71-97b6-81cf863c0f4c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:37.110122 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Creating config drive at /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config
May 13 04:14:37.127808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bdlsz59 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:37.235570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bdlsz59" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:37.293226 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:37.295497 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:37.296590 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:37.300538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1b30bee-b698-4d6e-a60e-afefd46c25aa req-447ed787-c965-4a07-afc4-649f81a9478f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-37cdbc96-1ec2-42b4-a204-e478fcc3e152 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:37.306417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:37.307590 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:37.310450 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:35:ec:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:37.311756 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e716f8c9-c01a-481a-a1df-949154aab1d3 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:37.324366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:37.330595 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:37.340023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.341870 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.347352 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.348233 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.352731 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.353474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37cdbc96-1e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.358187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.362308 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.369707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:37.369969 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:37.370155 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:37.370315 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:37.371359 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:37.373850 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received unexpected event network-vif-plugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with vm_state stopped and task_state powering-on.
May 13 04:14:37.373850 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:37.374407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:37.374407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:37.374407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:37.374593 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:37.375611 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ce7b984-8762-4991-aac6-bfd3efbbbebd req-a7ecde45-2960-4643-bbbd-9b01c3175ff0 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:37.395216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.399357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.399595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=314c6285-e4d2-4737-8dd4-1bb887c662a0) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.401685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.402367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.445920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.452096 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:64:85,bridge_name='br-int',has_traffic_filtering=True,id=37cdbc96-1ec2-42b4-a204-e478fcc3e152,network=Network(ed408f65-b0e8-4cbd-92ef-d6da998e3ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cdbc96-1e')
May 13 04:14:37.453021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.453249 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.453812 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.454167 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.458989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.459228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc8529f-72, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.463766 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.465959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.484032 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:37.510573 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.512501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.512501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d32149e-8c0a-4cbf-9c5d-92ca7256c9bf) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.519670 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.519670 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.554954 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.561881 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:7a,bridge_name='br-int',has_traffic_filtering=True,id=8bc8529f-7284-4f43-9ec5-3f81fe1525e1,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8bc8529f-72')
May 13 04:14:37.563082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.563287 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.563866 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.564150 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.565305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.565525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15fd9d97-7b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.568024 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.572614 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.606660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.609521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.610852 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=510d9ac4-c07e-4a97-b520-6c58e06e2c5a) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.613590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.614261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.641468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.643993 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:c7,bridge_name='br-int',has_traffic_filtering=True,id=15fd9d97-7b28-481c-8552-6586f7ef52a7,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15fd9d97-7b')
May 13 04:14:37.644851 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.645060 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.645939 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.646292 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.649797 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.649797 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52a69c6a-c1, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.649797 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.649797 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.677257 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.678518 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.678704 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e31d08ca-ae96-4cb3-a60a-3c7a0c094047) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.679448 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.679923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.704190 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.712088 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:74,bridge_name='br-int',has_traffic_filtering=True,id=52a69c6a-c114-429e-9e88-089a268659ef,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a69c6a-c1')
May 13 04:14:37.713174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.713304 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.713997 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.714201 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.716962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.716962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa40f75d4-7b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.720104 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.721402 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.738997 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.741367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.741512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2760d05c-60b2-47ec-a94f-a06fabb4809d) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.742164 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.743016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.763621 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.770728 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:52,bridge_name='br-int',has_traffic_filtering=True,id=a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8,network=Network(7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40f75d4-7b')
May 13 04:14:37.774350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.774350 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "7519bd91-ff41-462a-bf95-4463fabca8e7", "address": "fa:16:3e:62:0c:74", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7519bd91-ff", "ovs_interfaceid": "7519bd91-ff41-462a-bf95-4463fabca8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.774689 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.774828 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.777386 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.781354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7519bd91-ff, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.781354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.783297 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.796020 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.798929 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.799145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee4f9956-4909-466c-855c-7db306bd85b5) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.799987 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.800692 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.812824 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.816350 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:74,bridge_name='br-int',has_traffic_filtering=True,id=7519bd91-ff41-462a-bf95-4463fabca8e7,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7519bd91-ff')
May 13 04:14:37.816350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-502767274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-502767274',id=9,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFLnU48qWYWFkljOiNT4J1na12nTJr6suq7HlfpEFhJIXMRIppejqogiVjqrdMwznFcFJZ7svZ2Ifu0dkinpKKhpUkT0EGXhSAXEwCzpHV/rWOZxth9UCqwGNUzccE2Pg==',key_name='tempest-keypair-1383508310',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:13:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9f82df01ea4b71bca6616768a403f5',ramdisk_id='',reservation_id='r-w1hgc930',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-900760130',owner_user_name='tempest-TaggedBootDevicesTest_v242-900760130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d61d62838a74be387b7339e3ae75fd1',uuid=2e964c65-b87f-4c85-bbae-b83d3bb8fcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:37.816350 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converting VIF {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:37.818442 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:37.818442 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:37.818442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.818708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9858795-fb, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.830581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.835258 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.838521 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:14:37.839103 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999726090999957 future=<Future at 0x7a463c7c6cc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:37.841642 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.842063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=383ed798-f7dd-405e-8a87-3162dae14e90) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:37.844332 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:37.855531 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:37.858778 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:66,bridge_name='br-int',has_traffic_filtering=True,id=d9858795-fb99-4c2f-be09-bd2c041977c1,network=Network(8ba731ea-60fc-45a2-bc8d-36334ed61b13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9858795-fb')
May 13 04:14:37.862441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:14:37.862971 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:37.863092 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:37.863507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:37.864150 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459369df-c0de-4c59-98d8-d3b616f7dd28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:14:37.864316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:37.911091 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:37.911750 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:14:37.911750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '13')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:37.914214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28', '14')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:37.915357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b7560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'): ({'sdi'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:14:37.915984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:14:37.915984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Flush multipath device 33000000061990640 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:14:37.973191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:37.989359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b675bb2a-87b7-4586-a466-f73a80f4f521 req-116d1914-83d6-4f9f-84ef-f59ebdfd9a33 service nova] Releasing lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:37.990608 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquired lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:37.990608 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:38.031952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.032946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:38.057669 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.070624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.090946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:14:38.090946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:14:38.096425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:14:38.101641 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:38.101851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:38.102398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:38.102575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:38.102742 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:38.102929 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:38.103143 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:38.103249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:38.103570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:38.103683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:38.103791 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:38.106045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89354b2f-2ab5-43da-b89b-df6acc65c44b req-68483af0-cae5-4359-9fae-1e3316f86201 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-d9858795-fb99-4c2f-be09-bd2c041977c1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:38.131591 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:14:38.131591 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:14:38.147447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.197927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.203089 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.40.100,3260]
May 13 04:14:38.203089 np0000000669 nova-compute[97951]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.40.100,3260] successful.
May 13 04:14:38.203089 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.241520 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.244540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:38.251300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.269980 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.323739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.50.100,3260]
May 13 04:14:38.323739 np0000000669 nova-compute[97951]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-459369df-c0de-4c59-98d8-d3b616f7dd28, portal: 192.168.50.100,3260] successful.
May 13 04:14:38.323739 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.360257 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:38.361509 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:38.366384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.366895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:38.367447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== disconnect_volume: return (504ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:38.367447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:14:38.372341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.419956 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.420484 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:38.420484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:14:38.420903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '18')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:38.422070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad', '17')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:38.423862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c114540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'): ({'sdl'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:14:38.424202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Removing multipathed devices sdl, sdm {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:14:38.424458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Flush multipath device 330000000e5791847 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:14:38.457441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:38.509541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:38.554305 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:14:38.554543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:14:38.556486 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:14:38.574083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:14:38.574313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:14:38.592250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.614535 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:38.642929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.40.100,3260]
May 13 04:14:38.642929 np0000000669 nova-compute[97951]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.40.100,3260] successful.
May 13 04:14:38.642929 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.677974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.693678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.736815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.50.100,3260]
May 13 04:14:38.736815 np0000000669 nova-compute[97951]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8d45a4fd-760c-4a7c-8fec-35a225ebd1ad, portal: 192.168.50.100,3260] successful.
May 13 04:14:38.736815 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.771745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:38.771877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:38.773082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== disconnect_volume: return (400ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:38.773082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:14:38.774772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:14:38.775076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:38.775217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:38.775577 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:38.775881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8eda2b22-e827-4553-8dfe-f381270476a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:14:38.776009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.821824 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8 (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:38.822416 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:14:38.822416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '21')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:38.824908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8', '22')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:38.826182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c0c8c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'): ({'sdo'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:14:38.826468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Removing multipathed devices sdn, sdo {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:14:38.826708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Flush multipath device 3300000005feea97b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:14:38.863493 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:38.865035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:38.868713 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:38.915179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:38.966647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:14:38.966647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:14:38.967226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:14:38.984450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:14:38.984635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:14:38.998896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.042299 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Updating instance_info_cache with network_info: [{"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:39.048391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.40.100,3260]
May 13 04:14:39.048391 np0000000669 nova-compute[97951]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.40.100,3260] successful.
May 13 04:14:39.048391 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.079632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.093319 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.139736 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.50.100,3260]
May 13 04:14:39.139736 np0000000669 nova-compute[97951]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8eda2b22-e827-4553-8dfe-f381270476a8, portal: 192.168.50.100,3260] successful.
May 13 04:14:39.139736 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.162789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:39.162789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:39.162789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] <== disconnect_volume: return (386ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:39.162789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:14:39.163397 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Deleting instance files /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4_del
May 13 04:14:39.164144 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Deletion of /opt/stack/data/nova/instances/2e964c65-b87f-4c85-bbae-b83d3bb8fcb4_del complete
May 13 04:14:39.255297 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645679.2547984, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:39.255785 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Started (Lifecycle Event)
May 13 04:14:39.360531 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.360681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.360809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.361137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.361246 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.361389 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.361486 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.361646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.361701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.361797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.361858 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-8bc8529f-7284-4f43-9ec5-3f81fe1525e1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.362683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.362977 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.362977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.363139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.363539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.363654 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.363791 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-99c545b0-2a3e-4c00-a8df-8e32df13107d req-b0d62b8b-248a-4786-a9dc-3a96ec5d5f03 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-52a69c6a-c114-429e-9e88-089a268659ef for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.386297 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.249s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.386798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:14:39.414185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:39.468472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.468886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.469105 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.469265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.469432 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.469612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-15fd9d97-7b28-481c-8552-6586f7ef52a7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.469730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.469913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.470085 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.470222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.470784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.470784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.470784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:39.470909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Acquiring lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:39.470980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:39.471141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:39.471292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] No waiting events found dispatching network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:39.471547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c71d1e1e-172a-43e9-a64f-4f12bd41f70c req-da1c560f-6376-4f91-b71a-d51f5eb02aa1 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-unplugged-7519bd91-ff41-462a-bf95-4463fabca8e7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:39.544298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Releasing lock "refresh_cache-2737dcc6-03f8-4134-962a-8caa1a9eebae" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:39.544707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance network_info: |[{"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:39.546694 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Start _get_guest_xml network_info=[{"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:39.552278 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:39.552278 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-265807069', uuid='2737dcc6-03f8-4134-962a-8caa1a9eebae'), owner=OwnerMeta(userid='39f4dddbce124088851b259c812de432', username='tempest-VolumesAdminNegativeTest-1693197836-project-member', projectid='27177d2f7179467fbb0e8e2cfe34c105', projectname='tempest-VolumesAdminNegativeTest-1693197836'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645679.551267) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:39.553365 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:39.553773 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:39.556404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:39.556404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:39.556404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:39.556404 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:39.556404 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:39.556744 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:39.556744 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:39.556744 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:39.556830 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:39.556978 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:39.557131 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:39.557529 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:39.557529 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:39.557642 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:39.573147 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-265807069',display_name='tempest-VolumesAdminNegativeTest-server-265807069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesadminnegativetest-server-265807069',id=17,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27177d2f7179467fbb0e8e2cfe34c105',ramdisk_id='',reservation_id='r-3q5ms7uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1693197836',owner_user_name='tempest-VolumesAdminNegativeTest-1693197836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:35Z,user_data=None,user_id='39f4dddbce124088851b259c812de432',uuid=2737dcc6-03f8-4134-962a-8caa1a9eebae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:39.573437 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converting VIF {"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:39.573949 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:39.574997 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lazy-loading 'pci_devices' on Instance uuid 2737dcc6-03f8-4134-962a-8caa1a9eebae {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:39.674304 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Took 3.64 seconds to destroy the instance on the hypervisor.
May 13 04:14:39.674675 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:14:39.674903 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:14:39.675006 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:14:39.675269 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:39.761273 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:39.765787 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645679.764239, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:39.765787 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Paused (Lifecycle Event)
May 13 04:14:39.776962 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:39.894761 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:14:39.895272 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:14:39.895566 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:39.895899 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:40.009440 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0549cd57d1904853bbc5ac5116ea7f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd34c67006f4acc8b1a4ffc4bb599c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:14:40.080082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <uuid>2737dcc6-03f8-4134-962a-8caa1a9eebae</uuid>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <name>instance-00000011</name>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesAdminNegativeTest-server-265807069</nova:name>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:39</nova:creationTime>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:user uuid="39f4dddbce124088851b259c812de432">tempest-VolumesAdminNegativeTest-1693197836-project-member</nova:user>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:project uuid="27177d2f7179467fbb0e8e2cfe34c105">tempest-VolumesAdminNegativeTest-1693197836</nova:project>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         <nova:port uuid="ceadcc43-956a-4c2f-9230-07676ad1cee1">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="serial">2737dcc6-03f8-4134-962a-8caa1a9eebae</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="uuid">2737dcc6-03f8-4134-962a-8caa1a9eebae</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.config"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:20:9b:53"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <target dev="tapceadcc43-95"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/console.log" append="off"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:40.080082 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:40.083759 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Preparing to wait for external event network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:40.083936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:40.084209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:40.084430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:40.085081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-265807069',display_name='tempest-VolumesAdminNegativeTest-server-265807069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesadminnegativetest-server-265807069',id=17,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27177d2f7179467fbb0e8e2cfe34c105',ramdisk_id='',reservation_id='r-3q5ms7uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1693197836',owner_user_name='tempest-VolumesAdminNegativeTest-1693197836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:35Z,user_data=None,user_id='39f4dddbce124088851b259c812de432',uuid=2737dcc6-03f8-4134-962a-8caa1a9eebae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:40.085288 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converting VIF {"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:40.085867 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:40.086293 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:40.086817 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.087132 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:40.087428 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:40.088619 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.088804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc8d12e6-c574-5056-918e-7c8e660c5293', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:40.090067 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.090843 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:40.091684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.094118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.094355 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceadcc43-95, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:40.094687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceadcc43-95, col_values=(('qos', UUID('eb46ffd7-69e0-4c6a-9050-455d7b56fd0e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:40.094858 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceadcc43-95, col_values=(('external_ids', {'iface-id': 'ceadcc43-956a-4c2f-9230-07676ad1cee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:9b:53', 'vm-uuid': '2737dcc6-03f8-4134-962a-8caa1a9eebae'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:40.097606 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.098833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:40.107795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:40.109988 np0000000669 nova-compute[97951]: INFO os_vif [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95')
May 13 04:14:40.196520 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:40.196981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:40.197930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:40.197930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:40.198022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Processing event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:40.198187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:40.199360 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:40.199435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:40.199650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:40.200110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:40.202346 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:40.202346 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-eaabb3b1-aa2d-44fa-90de-42061dfe8742 req-3e8dc96f-cb2f-4d9c-811f-4caca83d7193 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state building and task_state spawning.
May 13 04:14:40.209366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:40.214900 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance spawned successfully.
May 13 04:14:40.215920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:40.269849 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:40.271403 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645680.2711313, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:40.271548 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Resumed (Lifecycle Event)
May 13 04:14:40.393756 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:14:40.710313 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Successfully created port: 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:14:40.727416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.729335 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.729335 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.729335 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.730899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.735851 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:40.774255 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:40.778872 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:40.898396 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:14:41.244526 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Took 10.98 seconds to spawn the instance on the hypervisor.
May 13 04:14:41.245604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:41.282953 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:41.469816 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Successfully updated port: 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:14:41.496754 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.003271490999850357 future=<Future at 0x7a463c136300 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.496932 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.497004 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.08696268499988946 future=<Future at 0x7a463c7b0ce0 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.497218 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.08686771199995746 future=<Future at 0x7a463c7b0ce0 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.497218 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.497315 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=11.341537327999959 future=<Future at 0x7a463c7c6cc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.497380 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=11.341439499999979 future=<Future at 0x7a463c7c6cc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:41.553676 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c2a10a55-3e37-4eda-b2d9-2e2dcaf070f8 req-b284e839-a1ad-4814-92b1-87a933b4746f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-deleted-7519bd91-ff41-462a-bf95-4463fabca8e7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:41.556716 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c2a10a55-3e37-4eda-b2d9-2e2dcaf070f8 req-b284e839-a1ad-4814-92b1-87a933b4746f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Neutron deleted interface 7519bd91-ff41-462a-bf95-4463fabca8e7; detaching it from the instance and deleting it from the info cache
May 13 04:14:41.557155 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c2a10a55-3e37-4eda-b2d9-2e2dcaf070f8 req-b284e839-a1ad-4814-92b1-87a933b4746f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9858795-fb99-4c2f-be09-bd2c041977c1", "address": "fa:16:3e:86:a7:66", "network": {"id": "8ba731ea-60fc-45a2-bc8d-36334ed61b13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1551659578", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9858795-fb", "ovs_interfaceid": "d9858795-fb99-4c2f-be09-bd2c041977c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:41.639195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:41.639347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:41.639497 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] No VIF found with MAC fa:16:3e:20:9b:53, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:41.639955 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Using config drive
May 13 04:14:41.757547 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Took 22.53 seconds to build instance.
May 13 04:14:41.795763 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4c996f45-52b7-4bfd-83c0-415612dd5430 req-dcf829b4-08b2-473a-8ba6-4640119c331f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-deleted-d9858795-fb99-4c2f-be09-bd2c041977c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:41.795861 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-4c996f45-52b7-4bfd-83c0-415612dd5430 req-dcf829b4-08b2-473a-8ba6-4640119c331f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Neutron deleted interface d9858795-fb99-4c2f-be09-bd2c041977c1; detaching it from the instance and deleting it from the info cache
May 13 04:14:41.796499 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4c996f45-52b7-4bfd-83c0-415612dd5430 req-dcf829b4-08b2-473a-8ba6-4640119c331f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [{"id": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "address": "fa:16:3e:d0:64:85", "network": {"id": "ed408f65-b0e8-4cbd-92ef-d6da998e3ffb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-377952000-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cdbc96-1e", "ovs_interfaceid": "37cdbc96-1ec2-42b4-a204-e478fcc3e152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "address": "fa:16:3e:8e:81:7a", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc8529f-72", "ovs_interfaceid": "8bc8529f-7284-4f43-9ec5-3f81fe1525e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "address": "fa:16:3e:84:20:c7", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fd9d97-7b", "ovs_interfaceid": "15fd9d97-7b28-481c-8552-6586f7ef52a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52a69c6a-c114-429e-9e88-089a268659ef", "address": "fa:16:3e:6e:5c:74", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a69c6a-c1", "ovs_interfaceid": "52a69c6a-c114-429e-9e88-089a268659ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "address": "fa:16:3e:be:1c:52", "network": {"id": "7ab3c256-1ad2-4a2d-931e-3b5c6cb6d30b", "bridge": "br-int", "label": "tempest-device-tagging-net1-777851326", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c9f82df01ea4b71bca6616768a403f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40f75d4-7b", "ovs_interfaceid": "a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:41.918469 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:14:41.919453 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:14:41.922502 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Creating image(s)
May 13 04:14:41.923219 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:41.923437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:41.925612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:41.926396 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:41.931731 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:41.932708 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:41.973667 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:41.973813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:41.973952 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:42.050565 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.118s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.051634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:42.051634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:42.054018 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:42.059587 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:42.059587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:42.081235 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c2a10a55-3e37-4eda-b2d9-2e2dcaf070f8 req-b284e839-a1ad-4814-92b1-87a933b4746f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Detach interface failed, port_id=7519bd91-ff41-462a-bf95-4463fabca8e7, reason: Instance 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:14:42.149812 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:42.182628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.184404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:42.252089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk 1073741824" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.255749 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:42.257111 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:42.260524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d5721e00-0998-4993-96d1-ea4b20893dba tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.043s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:42.328626 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4c996f45-52b7-4bfd-83c0-415612dd5430 req-dcf829b4-08b2-473a-8ba6-4640119c331f service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Detach interface failed, port_id=d9858795-fb99-4c2f-be09-bd2c041977c1, reason: Instance 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:14:42.347934 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:42.348705 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing instance network info cache due to event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:42.348705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:42.355524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.358023 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:14:42.358023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:42.447869 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Creating config drive at /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.config
May 13 04:14:42.452284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe9balzzu {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:42.469825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Cannot resize image /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Ensure instance console log exists: /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:42.475883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:42.519732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe9balzzu" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:42.575381 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:14:42.796758 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:42.969572 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:43.088348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.123444 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.126068 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.272446 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.473748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:43.473748 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance network_info: |[{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:14:43.476675 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start _get_guest_xml network_info=[{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:43.477638 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:43.478103 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:43.481084 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:43.483064 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1627906994', uuid='0c26601c-8a4a-49fd-bb81-a146023d95fb'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645683.4823763) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:43.486117 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:43.486117 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:43.486900 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:43.487113 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:43.488250 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:43.488670 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:43.488896 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:43.489110 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:43.489230 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:43.489501 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:43.489648 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:43.490466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:43.490466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:43.490466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:43.490466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:43.490466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:43.507253 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1627906994',display_name='tempest-ServerRescueNegativeTestJSON-server-1627906994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-1627906994',id=18,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVRUTeAg7oPBQCOjlnqXydXB6FT3Bmr7dDTvlUMK6eviUCFtlkJLOXzzjO3FfX25cL2CPSYCQWLcVB4OfGbjyRcU13rSSp/9YVL0rXVewsMMwGX5rziSdXWvxku9sstXA==',key_name='tempest-keypair-1383904969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4nzcgc4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=0c26601c-8a4a-49fd-bb81-a146023d95fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:43.507694 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:43.509445 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:43.509445 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:43.539685 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:43.566866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.574933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.581598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.608548 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:43.664397 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7b22621b-f6f2-44da-b508-84223a80249c req-318329be-a8e4-43ee-adfe-ef0f2b6a225c service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-deleted-a40f75d4-7b5b-49ad-8eb2-f7c5468df1f8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:43.868278 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Rescuing
May 13 04:14:43.868740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:43.869252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:43.869252 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:14:43.874258 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-deleted-52a69c6a-c114-429e-9e88-089a268659ef {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:43.874821 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:43.875114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:43.875401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:43.875530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:43.875696 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Processing event network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:43.875878 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:43.876073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:43.878685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:43.878685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:43.878685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] No waiting events found dispatching network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:43.878685 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1619de26-5901-474c-b6ca-db80ee2e37f3 req-3703fcd7-ea43-446b-8029-89941defaf33 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received unexpected event network-vif-plugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 for instance with vm_state building and task_state spawning.
May 13 04:14:43.984177 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <uuid>0c26601c-8a4a-49fd-bb81-a146023d95fb</uuid>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <name>instance-00000012</name>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1627906994</nova:name>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:43</nova:creationTime>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         <nova:port uuid="1f41e74f-330f-4a30-a571-bb4455851fa5">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="serial">0c26601c-8a4a-49fd-bb81-a146023d95fb</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="uuid">0c26601c-8a4a-49fd-bb81-a146023d95fb</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:7b:ab:b5"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <target dev="tap1f41e74f-33"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/console.log" append="off"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:44.014813 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Preparing to wait for external event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:44.014813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1627906994',display_name='tempest-ServerRescueNegativeTestJSON-server-1627906994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-1627906994',id=18,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVRUTeAg7oPBQCOjlnqXydXB6FT3Bmr7dDTvlUMK6eviUCFtlkJLOXzzjO3FfX25cL2CPSYCQWLcVB4OfGbjyRcU13rSSp/9YVL0rXVewsMMwGX5rziSdXWvxku9sstXA==',key_name='tempest-keypair-1383904969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4nzcgc4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=0c26601c-8a4a-49fd-bb81-a146023d95fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:44.022715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:14:44.024945 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.026731 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12c84144-a9cf-55d9-ad2c-59703edcff2c', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:44.033446 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.036225 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:44.039609 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.039967 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f41e74f-33, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:44.040377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f41e74f-33, col_values=(('qos', UUID('8974ab0d-87fd-4d93-8a1e-528350d6d59e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:44.041224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f41e74f-33, col_values=(('external_ids', {'iface-id': '1f41e74f-330f-4a30-a571-bb4455851fa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:ab:b5', 'vm-uuid': '0c26601c-8a4a-49fd-bb81-a146023d95fb'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:44.042395 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.047462 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:44.049628 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Took 4.37 seconds to deallocate network for instance.
May 13 04:14:44.053249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.057269 np0000000669 nova-compute[97951]: INFO os_vif [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33')
May 13 04:14:44.299008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:44.299730 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645684.2992468, 2737dcc6-03f8-4134-962a-8caa1a9eebae => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:44.299936 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] VM Started (Lifecycle Event)
May 13 04:14:44.302805 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:44.306976 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance spawned successfully.
May 13 04:14:44.311621 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:44.375234 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:44.387773 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:44.414606 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:44.442585 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37eb579b-0d18-449c-8fe1-3ea9e911b793 req-ba8de727-0d11-4f2e-9525-b886fd454e32 service nova] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Received event network-vif-deleted-37cdbc96-1ec2-42b4-a204-e478fcc3e152 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:44.610852 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updated VIF entry in instance network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:44.611760 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:44.802814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:44.805015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:44.817134 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:44.826307 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:44.826536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:44.826988 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:44.827300 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:44.827653 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:44.828190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:45.020309 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:45.113933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1da0590f-18e1-47e9-9561-30d55c6508dc req-ae95b1ec-a403-40f3-a2c4-7e3902615444 service nova] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:45.308883 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:45.308883 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645685.3083587, 2737dcc6-03f8-4134-962a-8caa1a9eebae => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:45.308883 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] VM Paused (Lifecycle Event)
May 13 04:14:45.334537 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Took 9.18 seconds to spawn the instance on the hypervisor.
May 13 04:14:45.335159 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:45.523883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:45.583898 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:45.584087 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:45.584230 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:7b:ab:b5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:45.584677 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Using config drive
May 13 04:14:45.767283 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Took 1.72 seconds to detach 3 volumes for instance.
May 13 04:14:45.813513 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:45.815997 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645685.8156257, 2737dcc6-03f8-4134-962a-8caa1a9eebae => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:45.816190 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] VM Resumed (Lifecycle Event)
May 13 04:14:45.845626 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Took 18.46 seconds to build instance.
May 13 04:14:46.090074 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:46.265422 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Creating config drive at /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config
May 13 04:14:46.271943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:46.272197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:46.272772 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjj9dood7 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:46.321827 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:46.324146 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:46.334555 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjj9dood7" returned: 0 in 0.061s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:46.347642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.976s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:46.875589 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:46.915728 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.022652 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.042806 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.045241 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.099048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:47.099186 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:47.127040 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4294e16-d698-46cb-80d2-b0523ef7f494 req-727e15f4-a89d-478d-83f9-44941902e4b3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:47.127435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4294e16-d698-46cb-80d2-b0523ef7f494 req-727e15f4-a89d-478d-83f9-44941902e4b3 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:47.128258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4294e16-d698-46cb-80d2-b0523ef7f494 req-727e15f4-a89d-478d-83f9-44941902e4b3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:47.129387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4294e16-d698-46cb-80d2-b0523ef7f494 req-727e15f4-a89d-478d-83f9-44941902e4b3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:47.129387 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4294e16-d698-46cb-80d2-b0523ef7f494 req-727e15f4-a89d-478d-83f9-44941902e4b3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Processing event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:14:47.155392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.162258 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.195655 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.343360 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.351159 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:47.421396 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:47.424915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:47.424915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:47.425147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:47.425147 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:47.425298 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-911291c7-2f66-47c4-b672-b9d1dd4590f1 req-8bb008a1-97e0-422e-b2ed-8949326bb485 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state active and task_state rescuing.
May 13 04:14:47.504002 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999566799999911 future=<Future at 0x7a463c0e3740 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:47.509467 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance destroyed successfully.
May 13 04:14:47.510467 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'numa_topology' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:47.604482 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:48.016336 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Attempting a stable device rescue
May 13 04:14:48.112623 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:14:48.113193 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645688.1127539, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:48.113418 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Started (Lifecycle Event)
May 13 04:14:48.117207 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.844s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:48.119171 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:14:48.122978 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance spawned successfully.
May 13 04:14:48.124150 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:14:48.144474 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:14:48.152744 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:14:48.152744 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Creating image(s)
May 13 04:14:48.154037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:48.154037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:48.154305 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:48.154549 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'trusted_certs' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:48.195696 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Deleted allocations for instance 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4
May 13 04:14:48.619352 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:48.621257 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:48.632215 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.632380 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.632697 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.633033 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.633399 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.633701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:14:48.659402 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:48.659402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "ab03132142d595e888683cfc4a4a83a4f3f44462" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:48.659402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ab03132142d595e888683cfc4a4a83a4f3f44462" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.045310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:49.128240 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:14:49.128240 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645689.1260498, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:49.128240 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Paused (Lifecycle Event)
May 13 04:14:49.141353 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Took 7.22 seconds to spawn the instance on the hypervisor.
May 13 04:14:49.141353 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:49.208455 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d7e1b5b-0861-4f63-91ce-4ff026b2c1f3 tempest-TaggedBootDevicesTest_v242-900760130 tempest-TaggedBootDevicesTest_v242-900760130-project-member] Lock "2e964c65-b87f-4c85-bbae-b83d3bb8fcb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.687s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.236021 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:49.237079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:49.237079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.237367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.237367 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:49.237682 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ca423abf-d050-45a9-8a5d-031f73b96443 req-33619465-d3f2-4ea0-ae57-ffe7c5eda81b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state building and task_state spawning.
May 13 04:14:49.419052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:49.493407 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.498211 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.498211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:49.525433 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:49.525997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:49.526436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.526751 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.526952 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:49.527154 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-80bee708-f695-4453-b9c3-35b9aee66c4d req-9b5c9ea4-3088-40c8-99d8-54e116421537 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state active and task_state rescuing.
May 13 04:14:49.550816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:49.551037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.551278 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:49.551485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.551644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.554736 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Terminating instance
May 13 04:14:49.592838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.part --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:49.593140 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] cf678128-7a22-43f9-9766-8714b5b93056 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:14:49.596362 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:14:49.596362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.part /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:49.631347 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:49.636086 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645689.6357293, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:49.636254 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Resumed (Lifecycle Event)
May 13 04:14:49.675665 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Took 14.85 seconds to build instance.
May 13 04:14:49.676092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.part /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.converted" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:49.681302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:49.802203 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462.converted --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:49.802878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ab03132142d595e888683cfc4a4a83a4f3f44462" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.145s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.803317 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.806818 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.808963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "ab03132142d595e888683cfc4a4a83a4f3f44462" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:49.809486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ab03132142d595e888683cfc4a4a83a4f3f44462" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:49.809798 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.812181 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:14:49.812482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:49.917314 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462 --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:49.922200 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462,backing_fmt=raw /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:49.976379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab03132142d595e888683cfc4a4a83a4f3f44462,backing_fmt=raw /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.rescue" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:49.976379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ab03132142d595e888683cfc4a4a83a4f3f44462" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:49.976379 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'migration_context' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:50.058819 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:14:50.097296 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.101307 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.128040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.129501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.144234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:50.148134 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:14:50.162416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.163498 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.177632 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.372s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:50.347504 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:50.347504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:50.347504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:50.349041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:50.349041 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] No waiting events found dispatching network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:50.349041 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6fc47fca-f530-4b2f-ac5d-1f78da73d509 req-2b07a48c-df29-4c71-8c8d-34c2443df958 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:50.436689 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Instance destroyed successfully.
May 13 04:14:50.437065 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lazy-loading 'resources' on Instance uuid 2737dcc6-03f8-4134-962a-8caa1a9eebae {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:50.488003 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:50.488348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:14:50.489177 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start _get_guest_xml network_info=[{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:90:a5:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf678128-7a22-43f9-9766-8714b5b93056', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'f780fcc0-01e6-461f-868d-1dddd9fbc1b4', 'attached_at': '', 'detached_at': '', 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'serial': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d'}, 'disk_bus': 'virtio', 'attachment_id': '27c0c295-f2e7-4305-819f-f5b7c0cfc309', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:14:50.489409 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:50.652775 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999690464999958 future=<Future at 0x7a463c7c4140 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:50.884611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.940073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-265807069',display_name='tempest-VolumesAdminNegativeTest-server-265807069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesadminnegativetest-server-265807069',id=17,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:45Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27177d2f7179467fbb0e8e2cfe34c105',ramdisk_id='',reservation_id='r-3q5ms7uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1693197836',owner_user_name='tempest-VolumesAdminNegativeTest-1693197836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:45Z,user_data=None,user_id='39f4dddbce124088851b259c812de432',uuid=2737dcc6-03f8-4134-962a-8caa1a9eebae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:50.940372 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converting VIF {"id": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "address": "fa:16:3e:20:9b:53", "network": {"id": "f9a5d4b5-1484-4d11-8767-70f5c6dc9acb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-221591070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "27177d2f7179467fbb0e8e2cfe34c105", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceadcc43-95", "ovs_interfaceid": "ceadcc43-956a-4c2f-9230-07676ad1cee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:50.941058 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:50.941282 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:50.945136 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.945522 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceadcc43-95, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:50.948189 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:50.953553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.954850 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.955095 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb46ffd7-69e0-4c6a-9050-455d7b56fd0e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:50.956285 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.957083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:50.963093 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:50.969258 np0000000669 nova-compute[97951]: INFO os_vif [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:9b:53,bridge_name='br-int',has_traffic_filtering=True,id=ceadcc43-956a-4c2f-9230-07676ad1cee1,network=Network(f9a5d4b5-1484-4d11-8767-70f5c6dc9acb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceadcc43-95')
May 13 04:14:50.969655 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Deleting instance files /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae_del
May 13 04:14:50.970546 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Deletion of /opt/stack/data/nova/instances/2737dcc6-03f8-4134-962a-8caa1a9eebae_del complete
May 13 04:14:50.991907 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:50.996722 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:14:50.998643 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156', uuid='f780fcc0-01e6-461f-868d-1dddd9fbc1b4'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:90:a5:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645690.9974604) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:14:50.999128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:14:50.999565 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:14:51.000820 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:14:51.000820 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:14:51.003003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:14:51.003498 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:14:51.003498 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:14:51.003498 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:14:51.003498 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:14:51.003648 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:14:51.003768 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:14:51.003868 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'vcpu_model' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:51.480855 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 04:14:51.483665 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:14:51.484013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:14:51.484155 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:14:51.484564 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:51.506623 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:51.522082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:51.603434 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:51.607038 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing instance network info cache due to event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:14:51.607318 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:14:51.607488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:14:51.607701 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:14:51.617352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:51.619690 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:51.623267 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:51.624366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:51.626405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:51.626405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:14:51.626405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:51.626405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:51.626405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:51.627421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:14:51.641623 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:51.642610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:51.643154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:51.643381 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:14:51.644302 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:51.645197 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:51.659981 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:51.659981 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:14:51.667875 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:14:51.667875 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:51.677825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:51.683432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.701053 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.701521 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:51.702127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.702664 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:51.702938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:51.703209 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:51.703566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:51.703723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:14:51.705442 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('9', '0', '0', 0) found on session 35 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:51.705663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:51.706085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('10', '0', '0', 0) found on session 36 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:14:51.706424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:14:51.723231 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 36 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:51.723446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:51.724027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 35 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:14:51.724257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:14:51.954651 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-01a863c5-8925-425f-9efb-94f04fae5ddf req-f0663d07-a195-46f1-bf1c-94c95123b233 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-deleted-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:51.954850 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-01a863c5-8925-425f-9efb-94f04fae5ddf req-f0663d07-a195-46f1-bf1c-94c95123b233 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Neutron deleted interface ceadcc43-956a-4c2f-9230-07676ad1cee1; detaching it from the instance and deleting it from the info cache
May 13 04:14:51.955246 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-01a863c5-8925-425f-9efb-94f04fae5ddf req-f0663d07-a195-46f1-bf1c-94c95123b233 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:52.112257 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:52.164000 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Detaching volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c
May 13 04:14:52.213738 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Attempting to driver detach volume a54ea61d-9bd5-427b-a4f2-f1c454b3df3c from mountpoint /dev/vdb
May 13 04:14:52.219609 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found disk vdb by alias ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:14:52.223232 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found disk vdb by alias ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:14:52.223232 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Attempting to detach device vdb from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:14:52.223232 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <alias name="ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c"/>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <serial>a54ea61d-9bd5-427b-a4f2-f1c454b3df3c</serial>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]: </disk>
May 13 04:14:52.223232 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:14:52.228750 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully detached device vdb from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the persistent domain config.
May 13 04:14:52.228750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] (1/8): Attempting to detach device vdb with device alias ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:14:52.228750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <alias name="ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c"/>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <serial>a54ea61d-9bd5-427b-a4f2-f1c454b3df3c</serial>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]: </disk>
May 13 04:14:52.228750 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:14:52.387765 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:52.441468 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:52.442152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] Acquiring lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:52.442375 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:52.442545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:52.442744 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] No waiting events found dispatching network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:52.442905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d414a671-e880-4b70-a8ec-e39b11052670 req-5d3b98c1-8701-43c0-96c1-ae619f774d6e service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Received event network-vif-unplugged-ceadcc43-956a-4c2f-9230-07676ad1cee1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:52.458599 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-01a863c5-8925-425f-9efb-94f04fae5ddf req-f0663d07-a195-46f1-bf1c-94c95123b233 service nova] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Detach interface failed, port_id=ceadcc43-956a-4c2f-9230-07676ad1cee1, reason: Instance 2737dcc6-03f8-4134-962a-8caa1a9eebae could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:14:52.563867 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:52.643833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:14:52.749215 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updated VIF entry in instance network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:14:52.749215 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:52.839380 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000491722999868216 future=<Future at 0x7a463c7c6cc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:52.840317 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Emitting event <LifecycleEvent: 1778645677.8387196, 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:52.840571 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:52.840834 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] VM Stopped (Lifecycle Event)
May 13 04:14:52.842375 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.660869383999852 future=<Future at 0x7a463c0e3740 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:52.842562 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.660656474999996 future=<Future at 0x7a463c0e3740 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:52.890833 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Took 1.41 seconds to deallocate network for instance.
May 13 04:14:52.971049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645692.9703386, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:14:52.971878 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c for instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:14:52.974101 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully detached device vdb from instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 from the live domain config.
May 13 04:14:52.974956 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:14:52.975263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:14:52.975413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:14:53.251494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f6d30b5-4802-4845-9361-9149cef92538 req-2a100231-a381-4b2a-8ed1-8f0883fb45de service nova] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:14:53.344512 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 2e964c65-b87f-4c85-bbae-b83d3bb8fcb4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:14:53.400244 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:53.400495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:53.660468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Found WWN 33000000053f91692 for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:14:53.660756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:53.660958 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '33000000053f91692', 'path': '/dev/dm-1', 'multipath_id': '33000000053f91692'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:53.661128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053f91692', 'path': '/dev/dm-1', 'multipath_id': '33000000053f91692'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:14:53.661917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.686s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:14:53.662552 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:14:53.662797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:14:53.703347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:14:53.704064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:14:53.704064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '27')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:53.705159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c', '28')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:14:53.705576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648233380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:14:53.705765 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:14:53.706077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flush multipath device 330000000a811576c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:14:53.733926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:53.782592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:14:53.817819 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:14:53.817973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:14:53.819487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:14:53.833491 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:14:53.833848 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:14:53.846761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.883773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260]
May 13 04:14:53.883773 np0000000669 nova-compute[97951]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.40.100,3260] successful.
May 13 04:14:53.883773 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.909494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.922665 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.961123 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260]
May 13 04:14:53.961123 np0000000669 nova-compute[97951]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a54ea61d-9bd5-427b-a4f2-f1c454b3df3c, portal: 192.168.50.100,3260] successful.
May 13 04:14:53.961123 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.985198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:14:53.985198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:14:53.985198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== disconnect_volume: return (1009ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:14:53.985198 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:14:54.122116 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:14:54.122395 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:14:54.172352 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1148087156',id=16,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:41Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-7lnb0o68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:41Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=f780fcc0-01e6-461f-868d-1dddd9fbc1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:90:a5:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:14:54.172352 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:90:a5:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:54.172352 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:54.173744 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:54.422481 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:54.552081 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'flavor' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:54.625460 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:14:54.676115 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:54.677794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] End _get_guest_xml xml=<domain type="qemu">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <uuid>f780fcc0-01e6-461f-868d-1dddd9fbc1b4</uuid>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <name>instance-00000010</name>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1148087156</nova:name>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:14:50</nova:creationTime>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         <nova:port uuid="1e2d911e-b54e-409e-a93c-5cc61bf9915f">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <system>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="serial">f780fcc0-01e6-461f-868d-1dddd9fbc1b4</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="uuid">f780fcc0-01e6-461f-868d-1dddd9fbc1b4</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </system>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <os>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </os>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <features>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </features>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   <devices>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <alias name="ua-0c9695ea-3162-4bb1-9e88-6f01e293ac6d"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-1"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <serial>0c9695ea-3162-4bb1-9e88-6f01e293ac6d</serial>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.rescue"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <boot order="1"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </disk>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:90:a5:22"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <target dev="tap1e2d911e-b5"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </interface>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/console.log" append="off"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </serial>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <video>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </video>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </rng>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:   </devices>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]: </domain>
May 13 04:14:54.677794 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:14:54.681866 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance destroyed successfully.
May 13 04:14:55.133381 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.733s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:55.223531 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Deleted allocations for instance 2737dcc6-03f8-4134-962a-8caa1a9eebae
May 13 04:14:55.557788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5dff3418-062a-4e52-a811-762df9f74f1a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.897s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:55.956648 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.066785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:56.066785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:56.066785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:56.066785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:56.066785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:56.067782 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Terminating instance
May 13 04:14:56.208190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:56.210717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:56.210717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:14:56.210717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:90:a5:22, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:14:56.210717 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Using config drive
May 13 04:14:56.239924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-15567268-f801-46ca-9bb3-ebdced70bbf1 tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Lock "2737dcc6-03f8-4134-962a-8caa1a9eebae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.688s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:56.384116 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.572620 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:14:56.610539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.613437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.645379 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.715042 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'ec2_ids' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:56.793491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.808694 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:56.946118 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999647737999794 future=<Future at 0x7a463c77ce30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:14:56.949239 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Instance destroyed successfully.
May 13 04:14:56.950436 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'resources' on Instance uuid 53f03b92-4378-4cea-be96-0fa95cecf2d7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:57.054379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:57.055064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:57.055343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:57.056721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:57.057655 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:57.057655 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1ef9c152-19ae-47c5-96c7-85c2859c174a req-f22f0f25-7ad5-4cd0-8e58-630affd6a315 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:57.222317 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:57.224269 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'keypairs' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:14:57.452897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-846114652',display_name='tempest-ServerActionsTestOtherA-server-970309316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-tempest-common-compute-instance-846114652',id=10,image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEJ9NDPlKX0CArLV+zzr/CB1BhHfVaMj3s+w7QGQuT5MTzkupZtLqt3qL0wjILKvEZN0AHLo5X1y2FptoN5w/QIysSpxJMYHUDWj/c0Cu8TNTfzUHO7bVVaKLObgL4Eog==',key_name='tempest-keypair-1945015867',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-p91oucd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=53f03b92-4378-4cea-be96-0fa95cecf2d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:14:57.455234 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "address": "fa:16:3e:20:6d:f2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9024f22-79", "ovs_interfaceid": "e9024f22-79d3-4f7e-acd7-cd0ff360720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:14:57.455234 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:14:57.455234 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:14:57.456545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.456859 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9024f22-79, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:57.458062 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.458866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:57.464868 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.466077 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.466295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d71eebb-4e6d-45d3-9605-a90fac1d0dcd) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:14:57.466705 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.467124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:14:57.472742 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:57.474659 np0000000669 nova-compute[97951]: INFO os_vif [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6d:f2,bridge_name='br-int',has_traffic_filtering=True,id=e9024f22-79d3-4f7e-acd7-cd0ff360720e,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9024f22-79')
May 13 04:14:57.478088 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Deleting instance files /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7_del
May 13 04:14:57.478088 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Deletion of /opt/stack/data/nova/instances/53f03b92-4378-4cea-be96-0fa95cecf2d7_del complete
May 13 04:14:57.728364 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:14:57.728364 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:57.985570 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 04:14:57.986507 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:14:57.986703 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:14:57.986915 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:14:57.987067 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:58.017743 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Creating config drive at /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config.rescue
May 13 04:14:58.022164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuixj6kz7 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:14:58.071971 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:14:58.089785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuixj6kz7" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:14:58.641479 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.676751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.689380 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4cb0dd82-065c-4032-a171-7322b058c2f6 req-f2fd77b9-b924-47c7-9f71-8534e782e78f service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-deleted-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:58.690495 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-4cb0dd82-065c-4032-a171-7322b058c2f6 req-f2fd77b9-b924-47c7-9f71-8534e782e78f service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Neutron deleted interface e9024f22-79d3-4f7e-acd7-cd0ff360720e; detaching it from the instance and deleting it from the info cache
May 13 04:14:58.691784 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4cb0dd82-065c-4032-a171-7322b058c2f6 req-f2fd77b9-b924-47c7-9f71-8534e782e78f service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:58.704727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.814913 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.845049 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.849001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.905436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:58.970784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:59.094664 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:14:59.154370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:14:59.154589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] Acquiring lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:14:59.155005 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:14:59.155154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:14:59.155285 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] No waiting events found dispatching network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:14:59.155450 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-724f2d2b-7fc4-46eb-b0bc-7221cda335a6 req-97d9f7e8-cdb5-443f-a21d-c0e877ca1de3 service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Received event network-vif-unplugged-e9024f22-79d3-4f7e-acd7-cd0ff360720e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:14:59.201013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4cb0dd82-065c-4032-a171-7322b058c2f6 req-f2fd77b9-b924-47c7-9f71-8534e782e78f service nova] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Detach interface failed, port_id=e9024f22-79d3-4f7e-acd7-cd0ff360720e, reason: Instance 53f03b92-4378-4cea-be96-0fa95cecf2d7 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:14:59.435187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:14:59.596899 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Took 1.61 seconds to deallocate network for instance.
May 13 04:14:59.727127 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for f780fcc0-01e6-461f-868d-1dddd9fbc1b4 due to new event <LifecycleEvent: 1778645699.7267447, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:14:59.727647 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645699.7267447, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:14:59.727647 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Resumed (Lifecycle Event)
May 13 04:14:59.733107 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-697eb378-f493-48a5-9165-54169a4bac3f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:00.107805 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:00.107984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:00.232311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:00.238367 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:00.747512 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645700.7461615, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:00.747512 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Started (Lifecycle Event)
May 13 04:15:00.777677 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:00.777920 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:00.781172 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:00.784508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:00.784508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:00.784508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:00.784508 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:00.784508 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state rescued and task_state None.
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:00.785430 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9e8a5153-049f-4e54-8672-b0ab7bb3d87e req-66ccd2b3-115a-495f-9cfc-3e6847c10fd7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state rescued and task_state None.
May 13 04:15:01.250385 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:01.252109 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:01.282831 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:01.369740 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Unrescuing
May 13 04:15:01.369967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:01.370061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:01.370199 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:01.560499 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:01.754661 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:15:01.796344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.688s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:01.872791 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:01.876118 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Deleted allocations for instance 53f03b92-4378-4cea-be96-0fa95cecf2d7
May 13 04:15:02.471560 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:02.503726 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004845650000788737 future=<Future at 0x7a463c0e3740 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:02.503853 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:02.504282 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.1484919409999748 future=<Future at 0x7a463c7c4140 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:02.504282 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.1484034099999008 future=<Future at 0x7a463c7c4140 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:02.575768 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:02.887759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa31b9de-82c4-4c52-bdf2-3831e1932bb4 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "53f03b92-4378-4cea-be96-0fa95cecf2d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.823s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:02.970357 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [{"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:03.472585 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-f780fcc0-01e6-461f-868d-1dddd9fbc1b4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:03.473687 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'flavor' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:03.891884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.012388 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.014693 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.043909 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.184556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.255365 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.256074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.394356 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99918715900003 future=<Future at 0x7a464828b770 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:04.404357 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance destroyed successfully.
May 13 04:15:04.404357 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'numa_topology' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:04.441773 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:04.451141 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:04.451266 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:04.451530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:04.451677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:04.451677 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:04.451864 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e2399ba4-67b9-442a-8784-95fa947549f0 req-9d9f3c09-4f5a-4601-a033-a1b2721b05fd service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state rescued and task_state unrescuing.
May 13 04:15:04.910289 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<f780fcc0-01e6-461f-868d-1dddd9fbc1b4> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:05.512964 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:05.538654 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:05.540275 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:05.654462 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003505839999888849 future=<Future at 0x7a463c7c4140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:05.654462 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:05.654462 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.292204247999962 future=<Future at 0x7a463c77ce30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:05.654462 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.292131695999842 future=<Future at 0x7a463c77ce30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:05.654890 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Emitting event <LifecycleEvent: 1778645690.6523702, 2737dcc6-03f8-4134-962a-8caa1a9eebae => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:05.655140 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] VM Stopped (Lifecycle Event)
May 13 04:15:05.667889 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:05.719385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:05.720699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:06.163924 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 2737dcc6-03f8-4134-962a-8caa1a9eebae] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:06.722088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for f780fcc0-01e6-461f-868d-1dddd9fbc1b4 due to new event <LifecycleEvent: 1778645706.7216074, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:15:06.722221 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645706.7216074, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:06.722298 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Resumed (Lifecycle Event)
May 13 04:15:06.724115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cb2baaf6-2813-4067-b937-bb6c00cf60da tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:06.996726 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:06.997831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:06.999842 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:07.000368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:07.000368 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:07.000368 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state active and task_state None.
May 13 04:15:07.000533 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:07.001685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:07.001685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:07.001685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:07.001685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:07.001685 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-4146c7ac-cd12-4cab-9610-724ae2a3ab11 req-66bc49d4-8486-4658-ba7a-eed7d88fa4e7 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state active and task_state None.
May 13 04:15:07.231527 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:07.241372 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:07.473591 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:07.707864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:07.707864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:07.745738 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645707.745264, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:07.746215 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Started (Lifecycle Event)
May 13 04:15:08.016195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:08.209970 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:08.252834 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:08.257722 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:08.787734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:08.787935 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:08.792846 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:08.792997 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Claim successful on node np0000000669
May 13 04:15:08.981667 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:08.981935 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:09.086382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:09.086587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:09.086792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:09.086979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:09.087113 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:09.087277 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-f74d706a-4c9f-4af2-bbae-8c7ec490ce5a req-1fa45358-d9a1-4d8b-8e78-fc2536ff9ebf service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received unexpected event network-vif-plugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with vm_state active and task_state None.
May 13 04:15:09.453552 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:09.484361 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:10.062745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:10.498318 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:10.498976 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:11.001427 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:11.507984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.720s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:11.508508 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:11.510659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.448s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:11.514363 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:11.514497 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Claim successful on node np0000000669
May 13 04:15:11.616398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:11.616578 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:11.945549 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00033605800012992404 future=<Future at 0x7a463c77ce30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:11.945855 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Emitting event <LifecycleEvent: 1778645696.9450917, 53f03b92-4378-4cea-be96-0fa95cecf2d7 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:11.945989 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:11.946191 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] VM Stopped (Lifecycle Event)
May 13 04:15:11.947068 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.445618828000079 future=<Future at 0x7a464828b770 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:11.947296 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.445387848000109 future=<Future at 0x7a464828b770 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:11.947402 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:12.015621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:12.015866 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:12.018863 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:12.019052 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:12.099115 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cffc8fad0694442ad05ced625bbe1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c2202127ca4ec4a872d2af2f5e4576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:12.122001 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:12.448615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f21d4caf-105e-471b-914d-44c1b2f1fbb1 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 53f03b92-4378-4cea-be96-0fa95cecf2d7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:12.474993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:12.524688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:12.525177 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:12.525177 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Shelving
May 13 04:15:12.527138 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:12.591002 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Successfully created port: 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:12.695960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:13.039664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:13.160860 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Successfully updated port: 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:13.214890 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-changed-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:13.215074 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Refreshing instance network info cache due to event network-changed-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:13.215905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:13.215905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:13.215905 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Refreshing network info cache for port 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:13.225764 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:13.226295 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:13.545932 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Booting with volume 606202ab-eaef-470a-af9d-f47457694f8b at /dev/vda
May 13 04:15:13.567818 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.574684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.596389 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.602519 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:13.603167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.614406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:15:13.618132 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.626155 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:13.639188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:13.665445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:13.682379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:15:13.682849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:15:13.692010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:15:13.694060 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fed5:a217', 'fe80::fc16:3eff:fe45:30d0', 'fe80::6843:efff:fe61:53aa', 'fe80::fc16:3eff:fe88:a3a5', 'fe80::fc16:3eff:fe8f:f852', 'fe80::fc16:3eff:fe36:b200', 'fe80::6c4d:54ff:fe4a:dcb4', 'fe80::fc16:3eff:fe2c:bb21', 'fe80::fc16:3eff:fe44:d051', 'fe80::c844:73ff:fe0e:1057', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe35:ec76', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:fe90:a522'] 
May 13 04:15:13.694226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:15:13.694226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:15:13.694530 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:13.694710 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating existing volume attachment record: 15ac8a36-4f45-4648-b914-e56c47072fd7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:15:13.721350 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:13.729953 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:13.740570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:13.740570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:13.740890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:13.740992 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:13.741260 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:13.741411 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-03ef736f-e5b2-4d67-9985-78e7eef18b71 req-75afebed-e390-4ea6-9a49-c9b134ff4977 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received unexpected event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with vm_state active and task_state shelving.
May 13 04:15:13.810916 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:13.882556 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999665540999786 future=<Future at 0x7a461c742840 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:13.883095 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999083189999965 future=<Future at 0x7a461c742840 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:13.883469 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99868196899979 future=<Future at 0x7a461c742840 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:13.884735 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance destroyed successfully.
May 13 04:15:13.885226 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'numa_topology' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:13.957220 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:14.238912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.728s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:14.239753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.543s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:14.240022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:14.245949 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:14.246074 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Claim successful on node np0000000669
May 13 04:15:14.453624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:14.462340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4240eead-fede-4330-a99f-e0324d996d48 req-f36f8862-f400-462d-b395-44ffbcadd16d service nova] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:14.464294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:14.464504 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:14.511773 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Beginning cold snapshot process
May 13 04:15:14.747938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:14.748413 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:14.748640 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:14.748878 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:14.830739 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f077cae41c324b0bac3646dc90ca89a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9bc4b864dd4763813e225868b7d67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:15.053272 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:15.249618 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:15.345890 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Successfully created port: fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:15.367616 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:15.611399 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:15.753235 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:15.828440 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:15.828775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:15.828968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:15.829036 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:15.829112 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:15.829223 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fdd6421d-8805-4aa4-841f-99b8bbea70d0 req-4f7c699c-597e-464d-8d97-24a27757f249 service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received unexpected event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with vm_state active and task_state shelving_image_pending_upload.
May 13 04:15:15.833370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:15.834161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:15.834335 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Creating image(s)
May 13 04:15:15.834583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:15:15.834704 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Ensure instance console log exists: /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:15.834915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:15.835209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:15.835273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:16.010303 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Successfully updated port: fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:16.027402 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:15:16.027688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk /opt/stack/data/nova/instances/snapshots/tmpt9uz2zwj/dcd305d8fc72446dbf51904ee94ebac9 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:16.046023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:16.046494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:16.046899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:16.047085 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:16.048758 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:16.061884 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Terminating instance
May 13 04:15:16.084344 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:16.085211 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:16.114572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:16.115280 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance network_info: |[{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:16.116386 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start _get_guest_xml network_info=[{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c527a60e-fb33-4b05-a851-91c95ebe0c8e', 'attached_at': '', 'detached_at': '', 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'serial': '606202ab-eaef-470a-af9d-f47457694f8b'}, 'disk_bus': 'virtio', 'attachment_id': '15ac8a36-4f45-4648-b914-e56c47072fd7', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:16.124128 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:16.126340 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2304711', uuid='c527a60e-fb33-4b05-a851-91c95ebe0c8e'), owner=OwnerMeta(userid='7cffc8fad0694442ad05ced625bbe1ad', username='tempest-ServerActionsTestOtherA-1572513959-project-member', projectid='03c2202127ca4ec4a872d2af2f5e4576', projectname='tempest-ServerActionsTestOtherA-1572513959'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645716.1257293) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:16.127401 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:16.127895 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:16.128821 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:16.129194 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:16.132201 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:16.132444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:16.133451 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:16.133835 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:16.133980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:16.134083 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:16.134194 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:16.134282 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:16.134444 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:16.134579 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:16.134698 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:16.134807 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:16.134909 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:16.135088 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:16.154941 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:15:16.155410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:16.155511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:16.155953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:16.156160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:15:16.170189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:16.171434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:16.172040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:16.172948 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:16.173430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:16.173683 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:16.185670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:16.185670 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:16.191359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:16.191359 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:16.198791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b] added
May 13 04:15:16.198791 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:16.198791 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:16.198791 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:16.198791 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:16.198791 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:16.198791 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:16.199578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:16.199578 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:16.199642 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:16.205654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b] added
May 13 04:15:16.205654 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:16.205654 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:16.205654 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:16.205654 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:16.205654 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:16.205654 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:16.205922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:16.206178 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:16.206292 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:16.362921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk /opt/stack/data/nova/instances/snapshots/tmpt9uz2zwj/dcd305d8fc72446dbf51904ee94ebac9" returned: 0 in 0.335s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:16.363308 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Snapshot extracted, beginning image upload
May 13 04:15:16.512342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:16.512488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:16.512576 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:16.567034 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:15:16.599751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:16.628517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:16.633015 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:16.641643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:16.666921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:16.765394 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:16.770046 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:16.770390 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Creating image(s)
May 13 04:15:16.770957 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:16.771230 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:16.773427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:16.773427 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:16.778032 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:16.780523 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:16.897173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:16.897173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:16.897647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:16.898010 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:16.902477 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:16.903464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:16.904618 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999706224999954 future=<Future at 0x7a461c712ab0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:16.927560 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Instance destroyed successfully.
May 13 04:15:16.932741 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'resources' on Instance uuid c230a3ec-2c84-425b-b594-f0c669d01bfe {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:17.000189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.097s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:17.000640 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:17.054476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk 1073741824" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:17.054833 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:17.055108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:17.082134 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:17.083470 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:17.084125 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:17.087450 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:17.135897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.081s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:17.136299 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:15:17.136557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:17.169852 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:17.174363 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.929s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:17.174363 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:17.200301 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:17.206895 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:17.225085 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:17.225085 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:17.229668 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:17.229668 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.233729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:17.234654 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Cannot resize image /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:15:17.235097 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:17.235344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Ensure instance console log exists: /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:17.235682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:17.235991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:17.236188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:17.243023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.252022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.261246 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.261724 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.274436 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.274720 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:17.307552 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260]
May 13 04:15:17.307552 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260] successful.
May 13 04:15:17.307552 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.321346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.323641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260]
May 13 04:15:17.323641 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260] successful.
May 13 04:15:17.323641 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.338206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.346303 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.346737 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:17.347040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:17.347166 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:17.349176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('7', '-', '-', 0) found on session 37 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:17.354237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:17.374686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 37 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:17.374961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:17.376247 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:17.376729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:17.376729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:17.378671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('8', '-', '-', 0) found on session 38 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:17.379342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:17.390941 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:17.396795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 38 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:17.396795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:17.441547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678076492',display_name='tempest-AttachVolumeTestJSON-server-678076492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-678076492',id=8,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4S5PM0En5hVy6PfSmjb2vfvEMVJkdYaf7yx4K+4qK0MHR1GhDaeRUtLd1h0rTR7Ak0i6DzMOoHN8CQyXRG43a/gCxdl+6Q/6b4qww5O94qOr2AWNXb7e8TZzIuWg0gA==',key_name='tempest-keypair-142518055',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:26Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-3jjcdp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=c230a3ec-2c84-425b-b594-f0c669d01bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:17.441891 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "address": "fa:16:3e:35:ec:76", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bec8c6-18", "ovs_interfaceid": "c0bec8c6-18c9-46f2-87ef-63d20e48e115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:17.442808 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:17.443262 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:17.445296 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.445746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0bec8c6-18, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:17.448886 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.449960 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:17.459058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.459928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.460288 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7329c333-51ec-490c-ac2f-affec9376815) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:17.461540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.465030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:17.470865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:17.475023 np0000000669 nova-compute[97951]: INFO os_vif [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:76,bridge_name='br-int',has_traffic_filtering=True,id=c0bec8c6-18c9-46f2-87ef-63d20e48e115,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bec8c6-18')
May 13 04:15:17.475350 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Deleting instance files /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe_del
May 13 04:15:17.479352 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Deletion of /opt/stack/data/nova/instances/c230a3ec-2c84-425b-b594-f0c669d01bfe_del complete
May 13 04:15:17.609596 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Updating instance_info_cache with network_info: [{"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:17.688746 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:17.688746 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:17.688746 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:17.688746 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:17.780357 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcc80bf8624b4787ad074f10f73872a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a830770c9b4796a5794a565f5f9336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:17.987288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-changed-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:17.987435 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Refreshing instance network info cache due to event network-changed-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:17.987583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Acquiring lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:17.993784 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Took 1.43 seconds to destroy the instance on the hypervisor.
May 13 04:15:17.995865 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:15:17.996216 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:15:17.996313 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:15:17.996590 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:18.079966 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:18.079966 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:18.112000 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:18.112252 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Instance network_info: |[{"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:18.114237 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Start _get_guest_xml network_info=[{"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:18.116085 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Acquired lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:18.116332 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Refreshing network info cache for port fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:18.122092 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:18.123688 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1266056070', uuid='2cf15625-daa9-41dd-b86a-1bddc18acfac'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645718.123224) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:18.129336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:18.131921 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:18.133763 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:18.136601 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:18.138470 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:18.140343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:18.140491 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:18.140931 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:18.140931 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:18.141035 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:18.141124 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:18.141240 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:18.141513 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:18.141763 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:18.141924 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:18.142074 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:18.142404 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:18.159464 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266056070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266056070',id=20,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-ujqix3fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:16Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=2cf15625-daa9-41dd-b86a-1bddc18acfac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:18.159679 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:18.160203 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:18.160874 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cf15625-daa9-41dd-b86a-1bddc18acfac {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:18.170255 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.174806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:15:18.189197 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:18.380559 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Successfully created port: ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:18.623513 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:18.663901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <uuid>2cf15625-daa9-41dd-b86a-1bddc18acfac</uuid>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <name>instance-00000014</name>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1266056070</nova:name>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:18</nova:creationTime>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         <nova:port uuid="fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="serial">2cf15625-daa9-41dd-b86a-1bddc18acfac</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="uuid">2cf15625-daa9-41dd-b86a-1bddc18acfac</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.config"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:10:76:97"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <target dev="tapfe9aaa1e-8e"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/console.log" append="off"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:18.663901 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Preparing to wait for external event network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266056070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266056070',id=20,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-ujqix3fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:16Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=2cf15625-daa9-41dd-b86a-1bddc18acfac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:18.666618 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:18.667089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.667089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:18.667089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:18.672350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.672350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22d1fa7b-a742-5cba-9a66-3e3b6879fb44', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:18.672350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.672350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:18.677760 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.680039 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.680194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9aaa1e-8e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:18.680585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe9aaa1e-8e, col_values=(('qos', UUID('982d60fa-77cd-4f9b-b375-5177f39d99bc')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:18.680825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe9aaa1e-8e, col_values=(('external_ids', {'iface-id': 'fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:76:97', 'vm-uuid': '2cf15625-daa9-41dd-b86a-1bddc18acfac'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:18.684828 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:18.693615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:18.698117 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:18.699014 np0000000669 nova-compute[97951]: INFO os_vif [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e')
May 13 04:15:18.799786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-344041be-4e1c-48d9-9a35-09085fa989a9 req-c7b1a422-bb2b-4ed7-a2d7-d05b855e7634 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-deleted-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:18.801838 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-344041be-4e1c-48d9-9a35-09085fa989a9 req-c7b1a422-bb2b-4ed7-a2d7-d05b855e7634 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Neutron deleted interface c0bec8c6-18c9-46f2-87ef-63d20e48e115; detaching it from the instance and deleting it from the info cache
May 13 04:15:18.801896 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-344041be-4e1c-48d9-9a35-09085fa989a9 req-c7b1a422-bb2b-4ed7-a2d7-d05b855e7634 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:19.031423 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Successfully updated port: ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:19.089203 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:19.089203 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:19.089203 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:19.122233 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-changed-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:19.122420 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Refreshing instance network info cache due to event network-changed-ccaadeda-1fb5-45f0-8390-231d698576c4. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:19.123317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:19.123317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:19.123540 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Refreshing network info cache for port ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:19.214352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found WWN 330000000ddfccc09 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:15:19.214801 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:19.214920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== connect_volume: return (3059ms) {'type': 'block', 'scsi_wwn': '330000000ddfccc09', 'path': '/dev/dm-0', 'multipath_id': '330000000ddfccc09'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:19.215444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ddfccc09', 'path': '/dev/dm-0', 'multipath_id': '330000000ddfccc09'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:15:19.247961 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:19.308082 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-344041be-4e1c-48d9-9a35-09085fa989a9 req-c7b1a422-bb2b-4ed7-a2d7-d05b855e7634 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Detach interface failed, port_id=c0bec8c6-18c9-46f2-87ef-63d20e48e115, reason: Instance c230a3ec-2c84-425b-b594-f0c669d01bfe could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:15:19.332924 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Updated VIF entry in instance network info cache for port fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:19.332924 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Updating instance_info_cache with network_info: [{"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:19.455860 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:19.534149 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:19.626384 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:19.681893 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Snapshot image upload complete
May 13 04:15:19.682446 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:19.714463 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:19.718594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:19.719842 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:19.720106 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Creating image(s)
May 13 04:15:19.720866 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:19.721134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:19.721742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:19.722218 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:19.723736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:19.723984 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:19.727687 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:19.728363 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'pci_devices' on Instance uuid c527a60e-fb33-4b05-a851-91c95ebe0c8e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:19.734791 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:19.735874 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:19.758225 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Took 1.76 seconds to deallocate network for instance.
May 13 04:15:19.838171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Releasing lock "refresh_cache-2cf15625-daa9-41dd-b86a-1bddc18acfac" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:19.838548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:19.838638 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:19.838867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:19.839007 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:19.839171 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:19.839344 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:19.839542 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:19.839633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Acquiring lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:19.839785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:19.839926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:19.840061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] No waiting events found dispatching network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:19.840271 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff049f98-bad2-49c3-bf5a-5462821637ee req-32a6c506-677a-4056-b76c-8aea4e5bf7a7 service nova] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Received event network-vif-unplugged-c0bec8c6-18c9-46f2-87ef-63d20e48e115 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:19.845746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:19.846300 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:19.849338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:19.849338 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:19.849602 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:19.849956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:19.939478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:19.941065 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:19.944172 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:19.997757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk 1073741824" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:20.001342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:20.001342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:20.084588 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:20.084732 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:15:20.085070 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:20.086970 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:20.087446 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:15:20.091353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:20.178600 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Cannot resize image /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Ensure instance console log exists: /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:20.181026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:20.194983 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Shelve offloading
May 13 04:15:20.236598 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <uuid>c527a60e-fb33-4b05-a851-91c95ebe0c8e</uuid>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <name>instance-00000013</name>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherA-server-2304711</nova:name>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:16</nova:creationTime>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:user uuid="7cffc8fad0694442ad05ced625bbe1ad">tempest-ServerActionsTestOtherA-1572513959-project-member</nova:user>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:project uuid="03c2202127ca4ec4a872d2af2f5e4576">tempest-ServerActionsTestOtherA-1572513959</nova:project>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         <nova:port uuid="1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="serial">c527a60e-fb33-4b05-a851-91c95ebe0c8e</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="uuid">c527a60e-fb33-4b05-a851-91c95ebe0c8e</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <alias name="ua-606202ab-eaef-470a-af9d-f47457694f8b"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <serial>606202ab-eaef-470a-af9d-f47457694f8b</serial>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a7:d9:5a"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <target dev="tap1f7bcbc4-b0"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/console.log" append="off"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:20.236598 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:20.238313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Preparing to wait for external event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:20.238313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:20.238313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:20.238313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:20.240546 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:20.241390 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:20.242604 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:20.243417 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:20.243825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.244312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:20.245003 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:20.247709 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.247933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '081596de-c7b9-5e78-a3c0-50ffeea5d149', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:20.248986 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.250137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:20.253004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:20.253193 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:20.253809 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:10:76:97, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:20.254485 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Using config drive
May 13 04:15:20.261967 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.264741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.264966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7bcbc4-b0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:20.265449 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7bcbc4-b0, col_values=(('qos', UUID('2a6dbafd-fd4e-40c9-8220-9e68eb30ba03')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:20.265954 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7bcbc4-b0, col_values=(('external_ids', {'iface-id': '1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:d9:5a', 'vm-uuid': 'c527a60e-fb33-4b05-a851-91c95ebe0c8e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:20.266824 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.268184 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:20.273888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:20.274215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:20.285936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:20.287045 np0000000669 nova-compute[97951]: INFO os_vif [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0')
May 13 04:15:20.455963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f2506b-2f5f-4616-81f7-8e4157ccf1a4 req-732c7c7c-a37d-45f1-9615-8cc8c79998b5 service nova] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:20.456360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:20.456605 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:20.703893 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance destroyed successfully.
May 13 04:15:20.704572 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:20.707740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:20.707740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:20.707740 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:20.762181 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:20.978624 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Creating config drive at /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.config
May 13 04:15:20.985202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdk3hsk_3 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:21.051885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdk3hsk_3" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:21.069089 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:21.085912 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:21.086939 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:21.087104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:21.087411 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:21.210359 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:21.302773 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:21.483627 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:21.591084 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:21.602482 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.647541 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.656202 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.706299 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:21.733473 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.772418 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.787997 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:21.821489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:21.821638 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:21.821791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:a7:d9:5a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:21.822523 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Using config drive
May 13 04:15:21.890604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-45ad7e66-9bbe-4db5-9a57-7a58c749948d req-25ed8d14-a806-4a2c-b0b3-f5dd6cd4829c service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:21.891042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45ad7e66-9bbe-4db5-9a57-7a58c749948d req-25ed8d14-a806-4a2c-b0b3-f5dd6cd4829c service nova] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:21.891225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45ad7e66-9bbe-4db5-9a57-7a58c749948d req-25ed8d14-a806-4a2c-b0b3-f5dd6cd4829c service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:21.891392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45ad7e66-9bbe-4db5-9a57-7a58c749948d req-25ed8d14-a806-4a2c-b0b3-f5dd6cd4829c service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:21.891656 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-45ad7e66-9bbe-4db5-9a57-7a58c749948d req-25ed8d14-a806-4a2c-b0b3-f5dd6cd4829c service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Processing event network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:21.942608 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:21.988649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:21.989133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance network_info: |[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:21.990703 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start _get_guest_xml network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:21.996654 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:21.997834 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2054040936', uuid='9aea12d5-7e2c-4027-8bba-51aff967d2e0'), owner=OwnerMeta(userid='bcc80bf8624b4787ad074f10f73872a8', username='tempest-ServerActionsTestOtherB-1906736706-project-member', projectid='e7a830770c9b4796a5794a565f5f9336', projectname='tempest-ServerActionsTestOtherB-1906736706'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645721.9974842) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:22.001313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:22.001566 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:22.003075 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:22.003075 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:22.003667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:22.004016 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:22.004187 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:22.004349 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:22.004534 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:22.004617 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:22.004726 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:22.004900 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:22.005027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:22.005148 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:22.005231 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:22.005424 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:22.016010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:22.016200 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:22.017062 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:22.017293 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:22.085621 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:22.100106 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.826s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:22.174780 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Deleted allocations for instance c230a3ec-2c84-425b-b594-f0c669d01bfe
May 13 04:15:22.331409 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:22.445046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:22.445262 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:22.445505 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:22.485368 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Creating config drive at /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config
May 13 04:15:22.489923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdw3upzfr {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:22.528207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <uuid>9aea12d5-7e2c-4027-8bba-51aff967d2e0</uuid>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <name>instance-00000015</name>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherB-server-2054040936</nova:name>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:21</nova:creationTime>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:user uuid="bcc80bf8624b4787ad074f10f73872a8">tempest-ServerActionsTestOtherB-1906736706-project-member</nova:user>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:project uuid="e7a830770c9b4796a5794a565f5f9336">tempest-ServerActionsTestOtherB-1906736706</nova:project>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         <nova:port uuid="ccaadeda-1fb5-45f0-8390-231d698576c4">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="serial">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="uuid">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:71:ea:9d"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <target dev="tapccaadeda-1f"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/console.log" append="off"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:22.528207 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:22.532392 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Preparing to wait for external event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:22.532392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:22.532392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:22.532392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:22.532762 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:22.532926 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:22.535228 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:22.536339 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:22.537344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.538196 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:22.538676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:22.541592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.541835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03dbe99b-d0d7-5329-9e5e-d8a22af5c471', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:22.547340 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:22.552903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.556994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.558018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccaadeda-1f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:22.558585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccaadeda-1f, col_values=(('qos', UUID('e0181112-258f-4550-b8e4-53498e3b155c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:22.558931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccaadeda-1f, col_values=(('external_ids', {'iface-id': 'ccaadeda-1fb5-45f0-8390-231d698576c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ea:9d', 'vm-uuid': '9aea12d5-7e2c-4027-8bba-51aff967d2e0'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:22.561873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.561873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:22.563953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdw3upzfr" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:22.575730 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:22.576558 np0000000669 nova-compute[97951]: INFO os_vif [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:15:22.593870 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:22.594026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:22.594196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:22.594423 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:15:22.617976 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645722.6175926, 2cf15625-daa9-41dd-b86a-1bddc18acfac => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:22.618143 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] VM Started (Lifecycle Event)
May 13 04:15:22.619837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:22.623807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:22.627643 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Instance spawned successfully.
May 13 04:15:22.628033 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:15:22.951446 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance destroyed successfully.
May 13 04:15:22.951446 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'resources' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:23.017922 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:23.017922 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing instance network info cache due to event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:23.017922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:23.017922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:23.020643 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:23.099060 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.122767 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:23.127767 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:23.143509 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.143901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.144108 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.144583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.144931 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.145358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.149697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.151537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:23.186798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29bf0d17-f57d-48dc-90d8-67bb817d2d18 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "c230a3ec-2c84-425b-b594-f0c669d01bfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.140s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:23.237470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.265315 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.276849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.452986 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:23.453839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6aeW+RLlxa49ucWhbKppnAmwoxqn9Z/gX2f0477L4JdJYwt1atJsLgRbnVlEwNQfvocn20ezH3rl/geF6DY7T7YvKPadxOz6BFLZSLdHiHXKV2NKEpaIEgEWQb3LxR8A==',key_name='tempest-keypair-792508241',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:24Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:15:19.682040',shelved_host='np0000000669',shelved_image_id='25dfae37-d72d-4a62-b40e-316c23c5864d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:23.454061 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:23.454658 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:23.454868 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:23.459751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.459963 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fe4fce9-68, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:23.461147 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.461871 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:23.470699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.472229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.472605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8078650d-2b54-429d-9729-06fc98edcb06) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:23.473238 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.474220 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:23.482151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:23.484304 np0000000669 nova-compute[97951]: INFO os_vif [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68')
May 13 04:15:23.484837 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Deleting instance files /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f_del
May 13 04:15:23.492592 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Deletion of /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f_del complete
May 13 04:15:23.522133 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:23.632935 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:15:23.632935 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645723.6316257, 2cf15625-daa9-41dd-b86a-1bddc18acfac => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:23.632935 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] VM Paused (Lifecycle Event)
May 13 04:15:23.658494 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Took 6.89 seconds to spawn the instance on the hypervisor.
May 13 04:15:23.658494 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:23.953878 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:23.971866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] No waiting events found dispatching network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received unexpected event network-vif-plugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 for instance with vm_state active and task_state None.
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Processing event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:23.976540 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fe4f42bd-67fb-48bb-bf35-607c13b5f018 req-42976b4e-4813-4532-8857-299cf0b18c32 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received unexpected event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with vm_state building and task_state spawning.
May 13 04:15:24.063088 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Deleted allocations for instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f
May 13 04:15:24.108416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:24.108548 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:24.108634 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No VIF found with MAC fa:16:3e:71:ea:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:24.109669 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Using config drive
May 13 04:15:24.116496 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updated VIF entry in instance network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:24.116886 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:24.137690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:24.140468 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645724.1393912, 2cf15625-daa9-41dd-b86a-1bddc18acfac => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:24.140468 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] VM Resumed (Lifecycle Event)
May 13 04:15:24.167709 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:24.171267 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:24.171808 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Took 14.18 seconds to build instance.
May 13 04:15:24.175942 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance spawned successfully.
May 13 04:15:24.177360 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:15:24.369859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:24.459421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:24.474073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:24.474313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:24.573853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:24.574202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:24.581309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:24.585029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:24.627765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e1523ae-24e3-4569-a10e-1fa83f39745c req-768da43f-4ca1-4eaa-8c45-6c744397f27d service nova] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:24.632150 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:24.642877 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:24.648378 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:24.685509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.699s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:24.693931 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.694663 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.695084 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.695404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.695711 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.695996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:24.718354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:24.719383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:24.779228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:24.828196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:24.832658 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'dd0d182d-62d3-4878-8fcb-b987cdbb5e1f' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dd0d182d-62d3-4878-8fcb-b987cdbb5e1f' (instance-0000000f)
May 13 04:15:24.835734 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:24.839937 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:24.980981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:24.982387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.106537 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Creating config drive at /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config
May 13 04:15:25.108511 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.117794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:25.130542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:25.130542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:25.130542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:25.131382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpxb3ck8 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.167017 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645725.1652558, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:25.167353 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Started (Lifecycle Event)
May 13 04:15:25.175878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.201709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpxb3ck8" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.212023 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Took 9.38 seconds to spawn the instance on the hypervisor.
May 13 04:15:25.215995 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:25.309850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.310831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.444837 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.448285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.577153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.577153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.646900 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:25.646900 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:25.701534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:25.705405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.710030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.731465 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:25.758170 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Took 17.04 seconds to build instance.
May 13 04:15:25.827453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.828596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:25.854555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:25.872897 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:25.958848 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:25.965388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:26.017610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:26.125404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:26.126528 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:26.162673 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:26.240796 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645726.2403154, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:26.241919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Paused (Lifecycle Event)
May 13 04:15:26.249041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:26.258918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:26.277089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fe29d219-c5a5-48d2-90cf-dfe9b52ffbe5 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.569s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:26.298274 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-972376ca-38e0-473b-8f7b-5729427c78e7 req-95f28e31-21d0-43c0-b0f5-6374fbddd60f service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:26.298559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-972376ca-38e0-473b-8f7b-5729427c78e7 req-95f28e31-21d0-43c0-b0f5-6374fbddd60f service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:26.298820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-972376ca-38e0-473b-8f7b-5729427c78e7 req-95f28e31-21d0-43c0-b0f5-6374fbddd60f service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:26.298953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-972376ca-38e0-473b-8f7b-5729427c78e7 req-95f28e31-21d0-43c0-b0f5-6374fbddd60f service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:26.299073 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-972376ca-38e0-473b-8f7b-5729427c78e7 req-95f28e31-21d0-43c0-b0f5-6374fbddd60f service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Processing event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:26.307229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:26.320627 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:26.344605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:26.354043 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:26.355376 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:26.504850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:26.509856 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:26.511302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:26.568674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:26.569345 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12487MB free_disk=74.37105941772461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:15:26.569345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:26.680436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.105s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:26.688796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.118s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:26.708944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:26.750688 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:26.757157 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645726.7566884, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:26.757350 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Resumed (Lifecycle Event)
May 13 04:15:27.091246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:27.091482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:27.112435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:27.112597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:27.145674 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:27.147485 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:27.148788 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance spawned successfully.
May 13 04:15:27.149233 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:15:27.180064 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:27.180064 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing instance network info cache due to event network-changed-455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:27.180253 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] Acquiring lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:27.180468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] Acquired lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:27.180571 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Refreshing network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:27.203100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd71bfbb-a0a3-4f20-ae5f-d3274aca74e3 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.678s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:27.227605 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] instance snapshotting
May 13 04:15:27.262449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:27.272295 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:27.360335 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Beginning live snapshot process
May 13 04:15:27.598810 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'flavor' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:27.615351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:27.657059 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.657217 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.657666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.657975 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.658636 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.659079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:27.686420 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:27.746347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:27.746347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:27.746513 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Unshelving
May 13 04:15:27.773223 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645727.7728202, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:27.774081 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Started (Lifecycle Event)
May 13 04:15:27.782389 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.782880 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 82e032bf-0b06-4188-9792-cc2de6b15ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783030 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 55d556b2-785a-44cd-b996-ff93c203bacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783278 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 51569bed-8bc3-4c71-97b6-81cf863c0f4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783359 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783466 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f780fcc0-01e6-461f-868d-1dddd9fbc1b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783610 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 0c26601c-8a4a-49fd-bb81-a146023d95fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783822 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c527a60e-fb33-4b05-a851-91c95ebe0c8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.783982 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2cf15625-daa9-41dd-b86a-1bddc18acfac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.784211 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 9aea12d5-7e2c-4027-8bba-51aff967d2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:15:27.892365 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:28.147415 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:28.168830 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Took 8.45 seconds to spawn the instance on the hypervisor.
May 13 04:15:28.169046 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:28.189630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:28.276754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:28.282630 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:28.296846 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d2031784-5e1a-4659-9673-b16764bf8111 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 04:15:28.297045 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance with task_state "unshelving" is not being actively managed by this compute host but has allocations referencing this compute node (7fc6428b-bc57-40b4-8243-357124d5276c): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1813}}
May 13 04:15:28.297286 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:15:28.297451 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:15:26 up 29 min,  2 users,  load average: 10.22, 5.96, 2.83\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_03c2202127ca4ec4a872d2af2f5e4576': '2', 'io_workload': '2', 'num_proj_5dd34c67006f4acc8b1a4ffc4bb599c1': '3', 'num_vm_rescued': '1', 'num_proj_4f6c259b2e604721a8cd6997f2d51f08': '1', 'num_proj_6a9bc4b864dd4763813e225868b7d67c': '3', 'num_task_image_snapshot': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_e7a830770c9b4796a5794a565f5f9336': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:15:28.381302 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updated VIF entry in instance network info cache for port 455a1a1b-3a1c-4b13-b24d-e88a7707574f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:28.381580 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [{"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:28.404685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:28.406116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:28.406116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:28.406116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:28.406116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:28.406116 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ab090107-c846-49a3-8c59-5e60e57d0ebb req-3d3b73dc-c508-4127-a2e0-2853fc45e269 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state active and task_state None.
May 13 04:15:28.473438 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:28.606464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:28.679355 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Took 16.05 seconds to build instance.
May 13 04:15:28.788390 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645728.7879543, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:28.788561 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Paused (Lifecycle Event)
May 13 04:15:28.881979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:28.898295 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.015963674000204264 future=<Future at 0x7a461c742840 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:28.910348 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Emitting event <LifecycleEvent: 1778645713.8820555, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:28.910803 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:28.912218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8e17bf-accd-4e1f-9998-14371b22cb3f req-afcb4687-0bda-4f2c-bb08-8b1a4a2e95a0 service nova] Releasing lock "refresh_cache-8d2f3521-15f2-4140-9561-7798bbe03f60" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:28.913311 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Stopped (Lifecycle Event)
May 13 04:15:28.916527 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.987674112999912 future=<Future at 0x7a461c712ab0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:28.916925 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.9872503609999512 future=<Future at 0x7a461c712ab0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:28.992529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json -f qcow2" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:28.993057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.078433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:29.079482 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:29.082409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:29.083265 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:29.085633 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:29.085923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.180484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:29.181299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5.delta 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.181777 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.564s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:29.251760 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5.delta 1073741824" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:29.252336 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 04:15:29.256114 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-changed-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:29.256483 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Refreshing instance network info cache due to event network-changed-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:29.256734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:29.257928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:29.258085 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Refreshing network info cache for port 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:29.265078 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Booting with volume c42af889-1c22-4787-a8c8-40f034c5cdbe at /dev/vdc
May 13 04:15:29.285390 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Stashing vm_state: active {{(pid=97951) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 04:15:29.292510 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:29.304833 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645729.3039927, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:29.304833 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Resumed (Lifecycle Event)
May 13 04:15:29.336607 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:29.352122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:15:29.380378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.420030 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:29.430877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:15:29.431901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:15:29.442792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:15:29.447715 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fed5:a217', 'fe80::fc16:3eff:fe45:30d0', 'fe80::6843:efff:fe61:53aa', 'fe80::fc16:3eff:fe88:a3a5', 'fe80::fc16:3eff:fe8f:f852', 'fe80::fc16:3eff:fe36:b200', 'fe80::6c4d:54ff:fe4a:dcb4', 'fe80::fc16:3eff:fe2c:bb21', 'fe80::fc16:3eff:fe44:d051', 'fe80::c844:73ff:fe0e:1057', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fea7:d95a', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5'] 
May 13 04:15:29.447903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:15:29.447976 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:15:29.448260 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:29.448512 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating existing volume attachment record: 4ca6a074-d857-4fcb-acc8-58c4a50e4db7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:15:29.461344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:29.552621 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:15:29.555349 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 04:15:29.586672 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:29.618570 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:15:29.618904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5.delta /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.716891 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:29.718383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:29.718383 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attaching volume 6d0f17cf-414a-45ca-8e2d-c4f6369634cd to /dev/vdb
May 13 04:15:29.724595 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5.delta /opt/stack/data/nova/instances/snapshots/tmpztlpgye3/cd7074450e9742daa874d9fa78c283e5" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:29.726020 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Snapshot extracted, beginning image upload
May 13 04:15:29.762968 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:29.783957 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:29.810889 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:29.810889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:15:29.821247 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:29.835195 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:29.882518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:15:29.883332 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:15:29.892171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:15:29.894194 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fed5:a217', 'fe80::fc16:3eff:fe45:30d0', 'fe80::6843:efff:fe61:53aa', 'fe80::fc16:3eff:fe88:a3a5', 'fe80::fc16:3eff:fe8f:f852', 'fe80::fc16:3eff:fe36:b200', 'fe80::6c4d:54ff:fe4a:dcb4', 'fe80::fc16:3eff:fe2c:bb21', 'fe80::fc16:3eff:fe44:d051', 'fe80::c844:73ff:fe0e:1057', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fea7:d95a', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5'] 
May 13 04:15:29.894369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:15:29.894481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:15:29.895482 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:29.895482 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating existing volume attachment record: 2ea6d7b9-4c2f-418a-834f-208da4bb7608 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:15:29.900862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:30.100723 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:15:30.101926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.413s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:30.101926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.914s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:30.102794 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:30.111637 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:30.111773 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Claim successful on node np0000000669
May 13 04:15:30.192023 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:30.376667 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updated VIF entry in instance network info cache for port 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:30.376667 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:30.465370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:15:30.465751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:30.465983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:30.466714 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:30.468150 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:15:30.478768 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-changed-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:30.480013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Refreshing instance network info cache due to event network-changed-ccaadeda-1fb5-45f0-8390-231d698576c4. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:30.480272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:30.480354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:30.480504 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Refreshing network info cache for port ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:30.482332 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:30.485083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:30.485948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:30.486254 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:30.486849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:30.487114 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:30.502308 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:30.502308 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:30.504446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:30.504446 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:30.517655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd] added
May 13 04:15:30.517655 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:30.517655 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:30.517655 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:30.517655 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:30.517655 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:30.517655 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:30.517929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:30.520603 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:30.520824 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:30.524872 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd] added
May 13 04:15:30.524872 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:30.524872 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:30.524872 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:30.524872 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:30.524872 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:30.524872 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:30.525260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:30.525260 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:30.525479 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:30.878995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-74f6a3ae-3eda-4f22-8376-d2adb51f5a37 req-f0bcbf79-d12a-48c7-8990-ac17140612ed service nova] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:30.962536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:30.962724 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:30.985815 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:31.102423 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:15:31.102775 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.98 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:31.143732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:31.441389 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:31.467359 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:31.521568 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:31.531144 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:31.544702 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:31.544702 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:31.551422 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:31.551422 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.561366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.568424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.584799 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.585300 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.598349 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:31.654843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.40.100,3260]
May 13 04:15:31.654843 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.40.100,3260] successful.
May 13 04:15:31.654843 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.657636 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updated VIF entry in instance network info cache for port ccaadeda-1fb5-45f0-8390-231d698576c4. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:31.657938 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:31.662088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.50.100,3260]
May 13 04:15:31.662088 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.50.100,3260] successful.
May 13 04:15:31.662088 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.674283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.681762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.702874 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.703427 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:31.703675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:31.703675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.704164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:31.704521 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:31.705481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] HCTL ('13', '-', '-', 0) found on session 39 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:31.705619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:31.705853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:31.705974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:31.707340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] HCTL ('14', '-', '-', 0) found on session 40 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:31.707483 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:31.729232 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching for a device in session 39 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:31.735667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:31.735667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching for a device in session 40 and hctl ['14', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:31.904924 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005203140001412976 future=<Future at 0x7a461c712ab0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:31.904924 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:31.905602 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Emitting event <LifecycleEvent: 1778645716.9040508, c230a3ec-2c84-425b-b594-f0c669d01bfe => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:31.905741 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] VM Stopped (Lifecycle Event)
May 13 04:15:32.037851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:32.161468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde7ae8e-486f-4290-9543-d5f2189bf57a req-8f32a3ca-f769-4b5a-9b8a-05d27cfe7e1b service nova] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:32.175845 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:32.176158 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:32.410382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-726274df-1301-4f20-be9a-8a50249bd23b tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: c230a3ec-2c84-425b-b594-f0c669d01bfe] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:32.500137 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Snapshot image upload complete
May 13 04:15:32.500489 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a8395738-1748-4919-bcbe-01cd485a2d07 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Took 5.27 seconds to snapshot the instance on the hypervisor.
May 13 04:15:32.679653 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:32.733416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching for a device in session 40 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:32.733416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:33.186282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.085s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:33.186904 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:33.188719 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 3.286s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:33.474506 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:33.503101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Found WWN 33000000095bca3bf for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:15:33.503472 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:33.503587 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000095bca3bf', 'path': '/dev/dm-7', 'multipath_id': '33000000095bca3bf'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:33.503742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000095bca3bf', 'path': '/dev/dm-7', 'multipath_id': '33000000095bca3bf'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:15:33.505784 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'flavor' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:33.697699 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:33.698380 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Claim successful on node np0000000669
May 13 04:15:33.701637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:33.701838 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:33.702109 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:33.702348 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:33.786940 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f4d2a3b569e43219b9d28dfb3990758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f6190e477e45ffb44a9f7754ab6965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:34.012080 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attempting to attach volume 6d0f17cf-414a-45ca-8e2d-c4f6369634cd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:15:34.013723 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:   <alias name="ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd"/>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:   <serial>6d0f17cf-414a-45ca-8e2d-c4f6369634cd</serial>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]: </disk>
May 13 04:15:34.013723 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:15:34.199000 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:34.211990 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating resource usage from migration 78e8a91f-d1db-40f2-babf-52a2127ac685
May 13 04:15:34.399653 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Successfully created port: 7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:34.464447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:34.540615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:34.541099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:34.702452 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:34.979338 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Successfully updated port: 7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:35.043527 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:15:35.046816 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-changed-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:35.046961 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Refreshing instance network info cache due to event network-changed-7d8ac866-d67a-4f7a-90ab-f456b3f1face. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:35.047142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] Acquiring lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:35.047246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] Acquired lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:35.047445 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Refreshing network info cache for port 7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:35.113852 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:35.114051 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:35.482539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:35.554071 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:35.617347 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:35.628269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:35.639263 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:35.689541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:35.689871 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:35.690065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:35.690230 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:7b:ab:b5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:35.709463 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:35.710331 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:35.710566 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Creating image(s)
May 13 04:15:35.711009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:35.711586 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:35.712110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:35.713887 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:35.719202 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:35.720569 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:35.807124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:35.807615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:35.808138 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:35.808612 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:35.812760 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:35.813536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:35.843544 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:35.911879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:35.912475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:35.970368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk 1073741824" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:35.971051 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:35.972700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:36.073839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:36.074537 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:15:36.074800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:36.130627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.944s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:36.131310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.987s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:36.131546 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Migrating
May 13 04:15:36.131808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:36.131914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "compute-rpcapi-router" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:36.138178 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_requests' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:36.171421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:36.171791 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Cannot resize image /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:15:36.172214 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:36.172392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Ensure instance console log exists: /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:36.172681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:36.172876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:36.173041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:36.348438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9fe01c11-63ae-4584-9375-0bf00fd1051e req-49f8a1b9-fd2e-4dfc-a7a4-699dac020bad service nova] Releasing lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:36.348850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquired lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:36.349054 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:36.636257 np0000000669 nova-compute[97951]: INFO nova.compute.rpcapi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 13 04:15:36.636919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "compute-rpcapi-router" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:36.637119 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:15:36.653857 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'numa_topology' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:36.930649 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:37.134310 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:37.158530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:37.158685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:37.158857 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:37.165128 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:37.165128 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Claim successful on node np0000000669
May 13 04:15:37.304886 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating instance_info_cache with network_info: [{"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:37.407420 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193db3e1-c92f-482c-9eac-50d257bf0eff tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.690s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:37.618879 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Rescuing
May 13 04:15:37.619049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:37.619134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:37.619242 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:37.662816 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:37.806841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Releasing lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:37.807109 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance network_info: |[{"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:37.809540 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Start _get_guest_xml network_info=[{"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:37.813457 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:37.816840 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-168287781', uuid='d2031784-5e1a-4659-9673-b16764bf8111'), owner=OwnerMeta(userid='3f4d2a3b569e43219b9d28dfb3990758', username='tempest-AttachVolumeTestJSON-1777051046-project-member', projectid='32f6190e477e45ffb44a9f7754ab6965', projectname='tempest-AttachVolumeTestJSON-1777051046'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645737.8150518) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:37.820869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:37.822031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:37.823605 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:37.824501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:37.825437 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:37.825741 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:37.825963 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:37.826068 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:37.826225 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:37.826305 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:37.826417 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:37.826546 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:37.826640 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:37.826736 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:37.826868 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:37.826983 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:37.837095 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168287781',display_name='tempest-AttachVolumeTestJSON-server-168287781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-168287781',id=22,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD8XFC8etUXmOOJbfgUCofN9ZJyCf9OJd7aCyEfe8bSGkslFtXcDXEXeWHsEhAqpqRTL9ARWZ3OPXLQ0GVK/BAtZPIA9cJ904Luwtdsbil99Sq6zloJrm8P/JPR6vzKg==',key_name='tempest-keypair-1258349435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-gwedwiet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=d2031784-5e1a-4659-9673-b16764bf8111,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:37.842125 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:37.842628 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:37.843731 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'pci_devices' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:38.071683 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:38.122498 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:38.223513 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <uuid>d2031784-5e1a-4659-9673-b16764bf8111</uuid>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <name>instance-00000016</name>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeTestJSON-server-168287781</nova:name>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:37</nova:creationTime>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:user uuid="3f4d2a3b569e43219b9d28dfb3990758">tempest-AttachVolumeTestJSON-1777051046-project-member</nova:user>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:project uuid="32f6190e477e45ffb44a9f7754ab6965">tempest-AttachVolumeTestJSON-1777051046</nova:project>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         <nova:port uuid="7d8ac866-d67a-4f7a-90ab-f456b3f1face">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="serial">d2031784-5e1a-4659-9673-b16764bf8111</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="uuid">d2031784-5e1a-4659-9673-b16764bf8111</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.config"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d6:81:22"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <target dev="tap7d8ac866-d6"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/console.log" append="off"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:38.349355 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Preparing to wait for external event network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:38.349355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:38.352612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168287781',display_name='tempest-AttachVolumeTestJSON-server-168287781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-168287781',id=22,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD8XFC8etUXmOOJbfgUCofN9ZJyCf9OJd7aCyEfe8bSGkslFtXcDXEXeWHsEhAqpqRTL9ARWZ3OPXLQ0GVK/BAtZPIA9cJ904Luwtdsbil99Sq6zloJrm8P/JPR6vzKg==',key_name='tempest-keypair-1258349435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-gwedwiet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=d2031784-5e1a-4659-9673-b16764bf8111,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:38.354077 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:38.354576 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:38.355147 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:38.358551 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.358865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:38.359115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:38.362493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.362702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67472859-f47d-507c-8a81-5d265c6870a2', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:38.368427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.369455 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:38.374563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.374970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d8ac866-d6, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:38.375550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d8ac866-d6, col_values=(('qos', UUID('40af0975-a791-4af9-bb76-c65a5fb2254b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:38.375833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d8ac866-d6, col_values=(('external_ids', {'iface-id': '7d8ac866-d67a-4f7a-90ab-f456b3f1face', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:81:22', 'vm-uuid': 'd2031784-5e1a-4659-9673-b16764bf8111'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:38.376948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.380445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:38.391315 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:38.393070 np0000000669 nova-compute[97951]: INFO os_vif [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6')
May 13 04:15:38.578357 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:38.730064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:38.770109 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:39.080900 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:39.081192 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:39.272732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:39.466747 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:39.584044 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:39.920630 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:39.921123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:39.921123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:d6:81:22, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:39.921508 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Using config drive
May 13 04:15:40.093523 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.963s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:40.093821 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:40.097781 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:15:40.098594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 8.061s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:40.103415 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:40.103415 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Claim successful on node np0000000669
May 13 04:15:40.224349 np0000000669 nova-compute[97951]: INFO nova.network.neutron [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d with attributes {'binding:host_id': 'np0000000669', 'device_owner': 'compute:nova'}
May 13 04:15:40.245295 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Starting migrate_disk_and_power_off {{(pid=97951) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 04:15:40.272581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.277014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.302494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.428841 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:40.437142 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.448076 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:40.462348 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-61ca3d2e-e601-416a-b188-dfb583a7f331 req-1e4c04e4-7a6f-4373-b429-00983e51736a service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received unexpected event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with vm_state active and task_state resize_migrating.
May 13 04:15:40.602050 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999593429000015 future=<Future at 0x7a463c154200 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:40.602622 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.9990666409999 future=<Future at 0x7a463c154200 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:40.602877 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998921666999877 future=<Future at 0x7a463c154200 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:40.606118 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance destroyed successfully.
May 13 04:15:40.607083 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:40.607356 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:40.607972 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:40.608308 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:40.611881 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.612123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7bcbc4-b0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:40.613375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.614169 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:40.622074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.623194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.623374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a6dbafd-fd4e-40c9-8220-9e68eb30ba03) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:40.623870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.624520 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:40.630659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.633171 np0000000669 nova-compute[97951]: INFO os_vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0')
May 13 04:15:40.635254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:15:40.635558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:40.635807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:40.636216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:40.636580 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:15:40.636733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:15:40.644074 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Creating config drive at /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.config
May 13 04:15:40.649725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw37q5z6g {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:40.684833 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:40.686106 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:15:40.686106 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '38')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:40.686918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '37')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:40.688217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464857e840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'): ({'sdb'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:15:40.688505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:15:40.688917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flush multipath device 330000000ddfccc09 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:15:40.705706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw37q5z6g" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:40.751889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:40.813905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:40.876428 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:15:40.876707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:15:40.878685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:15:40.896269 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:15:40.896585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:15:40.912060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:40.916911 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.941098 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:40.951594 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260]
May 13 04:15:40.951594 np0000000669 nova-compute[97951]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260] successful.
May 13 04:15:40.951594 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:40.969357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:40.972810 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:40.973254 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:40.977566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:40.991364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:41.027259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260]
May 13 04:15:41.027259 np0000000669 nova-compute[97951]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260] successful.
May 13 04:15:41.027259 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:41.038267 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:41.041680 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing instance network info cache due to event network-changed-7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:41.041928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] Acquiring lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:41.053277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:41.054558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:41.054558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== disconnect_volume: return (418ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:41.054558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:15:41.061817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:15:41.062471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e_resize/disk.config /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:41.102484 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.118175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "cp -r /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e_resize/disk.config /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config" returned: 0 in 0.055s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:41.118714 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.232044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.276002 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.478012 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:41.496382 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.498854 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999590905999867 future=<Future at 0x7a463c176e70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:41.502057 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance destroyed successfully.
May 13 04:15:41.502057 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:41.657825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.670690 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.675751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.703876 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.715468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:41.985727 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:42.016469 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attempting rescue
May 13 04:15:42.017079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:15:42.023596 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:15:42.023814 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Creating image(s)
May 13 04:15:42.024679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.024916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.025533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.025805 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:42.027663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.027663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.027663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.029757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.029757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.031082 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Terminating instance
May 13 04:15:42.130384 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:42.130774 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:42.148483 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:42.324354 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:42.324354 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:42.378833 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645742.378297, d2031784-5e1a-4659-9673-b16764bf8111 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:42.379175 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] VM Started (Lifecycle Event)
May 13 04:15:42.415632 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Port 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f binding to destination host np0000000669 is already ACTIVE {{(pid=97951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 04:15:42.528335 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:42.529194 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:42.533896 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:42.535235 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.535766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.536140 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:42.541783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:15:42.542306 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:42.542909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:42.569420 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:42.569820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.570170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.570339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.570668 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:42.570901 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received unexpected event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with vm_state active and task_state resize_migrating.
May 13 04:15:42.571078 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:42.571286 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.571701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.571849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.572164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:42.572164 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state active and task_state rescuing.
May 13 04:15:42.572572 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:42.572572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.572923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.572923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.573183 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:42.573519 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fbda01d2-320b-410d-9f82-22469675411c req-d9754be0-45ad-499d-8ac4-3baa882c5975 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state active and task_state rescuing.
May 13 04:15:42.578352 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.611214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.635337 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:42.650922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.652172 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:42.654004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:42.654953 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.657142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] Acquired lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:42.657344 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Refreshing network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:42.659967 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.659967 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating image(s)
May 13 04:15:42.660823 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.662343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.665595 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.665803 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:42.668802 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.126s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:42.671477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:42.726277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.rescue" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:42.729366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.729366 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'migration_context' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:42.731736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.820305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.850758 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.884062 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:42.895499 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645742.8909352, d2031784-5e1a-4659-9673-b16764bf8111 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:42.895499 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] VM Paused (Lifecycle Event)
May 13 04:15:42.895982 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.924688 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:42.953153 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:42.959135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:42.960013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:42.960013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:42.960013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:42.960239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4dbe8717-9055-4d64-9ca0-a49b30ac6ec6 req-96600804-a24b-4ef0-8173-4028707d67fa service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:42.960889 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.014304 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.060418 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.100707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.144832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:43.145783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:43.150706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.518s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.160161 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:15:43.160161 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Claim successful on node np0000000669
May 13 04:15:43.167276 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:43.180966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.183723 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:43.185647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:43.189181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.218792 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Processing event network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:43.222069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.222424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:43.222424 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] No waiting events found dispatching network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:43.222479 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received unexpected event network-vif-plugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face for instance with vm_state building and task_state spawning.
May 13 04:15:43.222689 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:43.223147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:43.223147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.225964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:43.226995 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:43.226995 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf2ab939-c469-4f95-9370-29bec8b66d44 req-da4b6907-b6ed-463b-b1bc-3aabb64f48fc service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:43.228156 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:43.235111 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:43.248460 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:43.251259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start _get_guest_xml network_info=[{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:7b:ab:b5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:43.259807 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:43.263440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:43.268815 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Instance destroyed successfully.
May 13 04:15:43.269114 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lazy-loading 'resources' on Instance uuid 51569bed-8bc3-4c71-97b6-81cf863c0f4c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:43.270658 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance spawned successfully.
May 13 04:15:43.272257 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:15:43.398658 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:43.401357 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645743.4010818, d2031784-5e1a-4659-9673-b16764bf8111 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:43.401528 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] VM Resumed (Lifecycle Event)
May 13 04:15:43.427014 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:15:43.438890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:43.439576 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:43.439576 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:43.661543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:43.662960 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:43.664943 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:43.664943 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:43.766473 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:43.771881 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:43.773412 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1627906994', uuid='0c26601c-8a4a-49fd-bb81-a146023d95fb'), owner=OwnerMeta(userid='0549cd57d1904853bbc5ac5116ea7f42', username='tempest-ServerRescueNegativeTestJSON-1023276944-project-member', projectid='5dd34c67006f4acc8b1a4ffc4bb599c1', projectname='tempest-ServerRescueNegativeTestJSON-1023276944'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:7b:ab:b5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645743.7730467) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:43.783167 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:43.783466 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "a27f493a-1be2-4677-9033-522c612e83fe", "address": "fa:16:3e:d5:a2:17", "network": {"id": "c609d7a4-ddc5-4a25-9799-775278886755", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1182616557-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa27f493a-1b", "ovs_interfaceid": "a27f493a-1be2-4677-9033-522c612e83fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:43.784483 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:43.784483 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:43.788023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.788402 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.788692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.788884 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.792349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.792349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.792349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:43.794105 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:43.794910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa27f493a-1b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.796112 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:43.799308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:43.799308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:43.799308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:43.799456 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:43.799665 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:43.799665 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:43.799770 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:43.799858 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:43.800432 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:43.800562 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:43.801042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.802314 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:43.802510 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:43.802818 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:43.806371 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:43.806371 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:43.806687 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:43.835884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.837167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.837234 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7569b01e-2755-45dc-9e67-5541061e749e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.838770 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.840140 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:43.870469 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04922e90c12c49569c5ef4bd0c667e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd845c7c9f6c54bcd93149d01872b0a43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:43.872870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.877168 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a2:17,bridge_name='br-int',has_traffic_filtering=True,id=a27f493a-1be2-4677-9033-522c612e83fe,network=Network(c609d7a4-ddc5-4a25-9799-775278886755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa27f493a-1b')
May 13 04:15:43.878029 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:43.878257 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:43.878738 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:43.878914 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:43.883021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.883021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39ba483c-84, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.883820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.886398 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:43.896911 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:43.907817 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:43.912379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:43.915883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.921353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.921353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a032e58-71fc-41fb-995d-36669d6d0fc6) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.921927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.923127 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:43.957163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.960927 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=39ba483c-84d3-4d58-b954-bb146bb3ced1,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39ba483c-84')
May 13 04:15:43.962046 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:43.962533 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:43.963635 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:43.964235 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:43.967074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.967283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap651fc391-a2, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.971066 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:43.996380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.998766 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:43.999125 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45db9074-09de-4750-af9f-051824bad304) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:43.999923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.000677 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.030597 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.042207 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a3:a5,bridge_name='br-int',has_traffic_filtering=True,id=651fc391-a28c-43c4-b10b-3c85424f6550,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap651fc391-a2')
May 13 04:15:44.043551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:44.044454 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:44.045072 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:44.045340 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:44.048004 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.048261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbee0585-5b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.050070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.051217 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.060308 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updated VIF entry in instance network info cache for port 7fe4fce9-6847-4bd4-8178-cb1962e7a63d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:44.060680 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:44.079411 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.080579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.080759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188910d1-b61d-477a-81c6-56e80253401a) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.081447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.082074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.103252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.105248 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f8:52,bridge_name='br-int',has_traffic_filtering=True,id=bbee0585-5bcd-474c-aec6-3a53564ab617,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbee0585-5b')
May 13 04:15:44.106164 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:44.106440 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:44.110832 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:44.111184 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:44.118792 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.118975 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf630024b-f3, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.120069 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.120742 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.131856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.133125 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.133360 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26a91026-2e57-414e-b4ac-0ff306090032) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.133961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.134698 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.148281 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.150500 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b2:00,bridge_name='br-int',has_traffic_filtering=True,id=f630024b-f368-4240-a2da-7de17c078e39,network=Network(75ac3a98-11f5-4197-b4d5-b32a13490076),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf630024b-f3')
May 13 04:15:44.151419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:44.151681 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:44.152284 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:44.152624 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:44.153974 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.154209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb63e16b-32, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.155430 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.156478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.162953 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:44.170070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.171310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.171587 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc8835c0-0cad-49c1-b605-11b1ef0638e4) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.172527 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.173386 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.184584 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.188548 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:bb:21,bridge_name='br-int',has_traffic_filtering=True,id=fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb63e16b-32')
May 13 04:15:44.189650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-381971309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-device-tagging-server-381971309',id=13,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQwjSCuDOn+fOy5u2pZXCOvVGBnqIg7E7vQu5ta1jSszDqEqarK5DMXhH8pG9/yCyIYnpLY3zLTosuYkfAtgPPTBNtxRxzSYLTS4b8vFg/IEqSj49U6O9EpC4+FgNCdhQ==',key_name='tempest-keypair-1203880615',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c259b2e604721a8cd6997f2d51f08',ramdisk_id='',reservation_id='r-5uf38qh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-458067948',owner_user_name='tempest-TaggedBootDevicesTest-458067948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a75d231f2f0f4a12aa29226dc1d306ba',uuid=51569bed-8bc3-4c71-97b6-81cf863c0f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:44.189824 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converting VIF {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:44.190301 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:44.190544 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:44.192477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.192715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11142b22-dc, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.193982 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.194515 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.201031 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.201283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.201416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0c8f33f-2af8-4266-91de-a2528416e2d3) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:44.201890 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.202545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:44.211279 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.213489 np0000000669 nova-compute[97951]: INFO os_vif [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=11142b22-dcac-4d65-9aa2-81ea9d7943c1,network=Network(f51de565-dcc4-499c-a47b-cb13152391fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11142b22-dc')
May 13 04:15:44.215131 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:15:44.215541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:44.215727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:44.216227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:44.216611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bacb0871-9431-4448-ba44-7623d237012e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:15:44.216759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.249974 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.251685 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:44.251896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:15:44.252074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '29')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:44.256851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e', '30')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:44.267063 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648283420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:15:44.267421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:15:44.267778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Flush multipath device 3300000004b75ede9 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:15:44.299614 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Took 8.59 seconds to spawn the instance on the hypervisor.
May 13 04:15:44.299688 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:44.309432 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:44.331199 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1627906994',display_name='tempest-ServerRescueNegativeTestJSON-server-1627906994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-1627906994',id=18,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVRUTeAg7oPBQCOjlnqXydXB6FT3Bmr7dDTvlUMK6eviUCFtlkJLOXzzjO3FfX25cL2CPSYCQWLcVB4OfGbjyRcU13rSSp/9YVL0rXVewsMMwGX5rziSdXWvxku9sstXA==',key_name='tempest-keypair-1383904969',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:49Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4nzcgc4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=0c26601c-8a4a-49fd-bb81-a146023d95fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:7b:ab:b5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:44.331513 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "vif_mac": "fa:16:3e:7b:ab:b5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:44.332498 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:44.334079 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:44.336085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:44.386129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:44.417091 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d2031784-5e1a-4659-9673-b16764bf8111] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:15:44.420078 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999789056000054 future=<Future at 0x7a463c0fdc40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:44.423877 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Successfully created port: cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:44.427842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:15:44.428031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:15:44.429564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:15:44.442924 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:15:44.443173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:15:44.455235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.461379 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:44.473561 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:44.494408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.40.100,3260]
May 13 04:15:44.494408 np0000000669 nova-compute[97951]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.40.100,3260] successful.
May 13 04:15:44.494408 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.518017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.533036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.563016 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fdb3dc32-01ab-4561-a194-cda1330199f5 req-248ab088-ba7d-4d10-991d-455b46db653d service nova] Releasing lock "refresh_cache-dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:44.570766 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:44.574813 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:44.576185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:44.576792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.50.100,3260]
May 13 04:15:44.576792 np0000000669 nova-compute[97951]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-bacb0871-9431-4448-ba44-7623d237012e, portal: 192.168.50.100,3260] successful.
May 13 04:15:44.576792 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.620357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.620357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:44.620357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== disconnect_volume: return (404ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:44.620620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:15:44.621919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:44.622077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:44.622230 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:44.626860 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:15:44.627183 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:44.627296 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:44.627703 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:44.628015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:15:44.628101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.657110 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132 (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:44.657469 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:44.657469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:15:44.657833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '32')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:44.658483 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132', '31')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:44.659222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12d940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:15:44.659512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:15:44.659773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Flush multipath device 33000000067101a07 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:15:44.667106 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:44.674564 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.677382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.677382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.677382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.677382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.677382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.678228 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.679920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.679920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.679920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.681094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.681841 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-a27f493a-1be2-4677-9033-522c612e83fe for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.682239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.684374 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-39ba483c-84d3-4d58-b954-bb146bb3ced1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.684879 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.684879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.684879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.684994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.685079 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.685240 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.685793 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:44.685984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:44.686170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:44.686335 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:44.686519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:44.686656 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f4a4b5de-e829-4b14-9170-d744c7b749de req-6c55b01a-780f-4bf3-aade-092be39fa063 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-11142b22-dcac-4d65-9aa2-81ea9d7943c1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:44.693340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:44.703508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.part --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:44.704385 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] 25dfae37-d72d-4a62-b40e-316c23c5864d was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:15:44.704936 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:15:44.704936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.part /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:44.738422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:44.785214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:15:44.785444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:15:44.786581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:15:44.801088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:15:44.801384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:15:44.818840 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.846690 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:44.847966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <uuid>0c26601c-8a4a-49fd-bb81-a146023d95fb</uuid>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <name>instance-00000012</name>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1627906994</nova:name>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:43</nova:creationTime>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:user uuid="0549cd57d1904853bbc5ac5116ea7f42">tempest-ServerRescueNegativeTestJSON-1023276944-project-member</nova:user>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:project uuid="5dd34c67006f4acc8b1a4ffc4bb599c1">tempest-ServerRescueNegativeTestJSON-1023276944</nova:project>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         <nova:port uuid="1f41e74f-330f-4a30-a571-bb4455851fa5">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="serial">0c26601c-8a4a-49fd-bb81-a146023d95fb</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="uuid">0c26601c-8a4a-49fd-bb81-a146023d95fb</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.rescue"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config.rescue"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:7b:ab:b5"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <target dev="tap1f41e74f-33"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/console.log" append="off"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:44.847966 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:44.852872 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Took 16.73 seconds to build instance.
May 13 04:15:44.855132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.40.100,3260]
May 13 04:15:44.855132 np0000000669 nova-compute[97951]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.40.100,3260] successful.
May 13 04:15:44.855132 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.864880 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance destroyed successfully.
May 13 04:15:44.882813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.895806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.928431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.50.100,3260]
May 13 04:15:44.928431 np0000000669 nova-compute[97951]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-2aee4d0a-f9bc-4909-a1a3-8bd22c9cc132, portal: 192.168.50.100,3260] successful.
May 13 04:15:44.928431 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.930111 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.part /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.converted" returned: 0 in 0.225s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:44.948339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:44.959689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:44.960438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:44.960678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== disconnect_volume: return (332ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:44.960911 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:15:44.981783 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:15:44.982392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:44.982609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:44.983361 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:44.983677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f19cde9-a046-4f51-a17a-ae9634df311a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:15:44.983836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsi session list stdout=tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:45.023992 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:15:45.023992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '34')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:45.025193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a', '33')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:15:45.026096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c6feb60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'): ({'sdp'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:15:45.026377 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Removing multipathed devices sdq, sdp {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:15:45.026685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Flush multipath device 330000000d00f01ad {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:15:45.062208 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.063872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456.converted --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.064677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.877s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.065624 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.065879 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.066190 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.066312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.066460 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.066580 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-bbee0585-5bcd-474c-aec6-3a53564ab617 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.066697 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.066880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.066931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.067140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.070506 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.073388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.074276 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.074554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:45.075787 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.077441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.077441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.077441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.077441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.077441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-882a216e-1f0a-44fb-9ed7-21b70c03063d req-97310926-95d1-4284-ad4c-4599d4d3923a service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.077668 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.118547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:15:45.132079 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:45.159039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:15:45.159233 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:15:45.160480 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:15:45.167766 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Successfully updated port: cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:45.171313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.174437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.174437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.174437 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.176045 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.176669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:15:45.176900 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:15:45.177953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.213739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.248613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.40.100,3260]
May 13 04:15:45.248613 np0000000669 nova-compute[97951]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.40.100,3260] successful.
May 13 04:15:45.248613 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.268210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.281057 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.314111 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json" returned: 0 in 0.137s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.314905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456,backing_fmt=raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.347567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.50.100,3260]
May 13 04:15:45.347567 np0000000669 nova-compute[97951]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-5f19cde9-a046-4f51-a17a-ae9634df311a, portal: 192.168.50.100,3260] successful.
May 13 04:15:45.347567 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.361580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.249s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.370944 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:45.371544 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:45.372794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] <== disconnect_volume: return (390ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:45.373010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:15:45.373778 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Deleting instance files /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c_del
May 13 04:15:45.374017 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Deletion of /opt/stack/data/nova/instances/51569bed-8bc3-4c71-97b6-81cf863c0f4c_del complete
May 13 04:15:45.386220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456,backing_fmt=raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk 1073741824" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.390349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "00ff7e78a864ff58ae82fcadc69a7e4c93a8d456" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.390349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.438963 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.439584 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.439584 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.439673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.442682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.442682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-f630024b-f368-4240-a2da-7de17c078e39 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.442682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.442682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.444459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.444711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.446824 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.447019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.447174 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.447357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Acquiring lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.449385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.449607 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.449797 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] No waiting events found dispatching network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:45.449938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-unplugged-651fc391-a28c-43c4-b10b-3c85424f6550 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:45.450087 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-changed-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:45.450286 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Refreshing instance network info cache due to event network-changed-cfe49895-aefa-495c-8b80-9085d149a449. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:45.450466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Acquiring lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:45.450579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Acquired lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:45.450795 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Refreshing network info cache for port cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:45.467447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:45.467584 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:45.497299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00ff7e78a864ff58ae82fcadc69a7e4c93a8d456 --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.498945 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'migration_context' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:45.634102 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:45.671585 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:45.727389 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:45.728753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:45.729017 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Creating image(s)
May 13 04:15:45.730227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.730461 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.731041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.731641 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.735682 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.736880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.795229 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:45.832468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.832756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:45.833219 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:45.833689 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.838681 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:15:45.839059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.884892 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Took 3.34 seconds to destroy the instance on the hypervisor.
May 13 04:15:45.885713 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:15:45.886050 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:15:45.886358 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:15:45.886764 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:45.934790 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.936298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:45.965359 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:45.971103 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:45.985295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk 1073741824" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:45.985777 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:45.986156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:46.007381 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:46.011335 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Rebasing disk image.
May 13 04:15:46.012451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:46.073591 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:46.085831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:46.086215 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:15:46.086510 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:46.123442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:46.124026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d -F raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:46.143749 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:46.173676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:46.174526 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Cannot resize image /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:15:46.176342 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:46.176342 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Ensure instance console log exists: /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:46.176342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:46.176342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:46.176342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:46.244439 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:46.298546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:46.396817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:46.396966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:46.397111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:46.397244 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] No VIF found with MAC fa:16:3e:7b:ab:b5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:46.397934 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Using config drive
May 13 04:15:46.481489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.335s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:46.481489 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:15:46.746825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0569c710-e388-4ac6-aa6a-58a880b3de83 req-b28a4d76-8a11-4257-bcb5-d9366c0f2da5 service nova] Releasing lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:46.747498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquired lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:46.747639 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:46.812792 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:46.826657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:15:46.849089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:46.900289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:15:46.901240 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:15:46.904345 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:46.912889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:15:46.915594 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2'] 
May 13 04:15:46.915753 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:15:46.915901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:15:46.918500 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:46.991049 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:15:46.993706 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:15:46.994116 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:46.994475 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:47.100570 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f077cae41c324b0bac3646dc90ca89a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9bc4b864dd4763813e225868b7d67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:15:47.277881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d -F raw /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk" returned: 0 in 1.154s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:47.278717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:15:47.278903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Ensure instance console log exists: /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:47.279289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:47.280355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:47.280355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:47.284376 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start _get_guest_xml network_info=[{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='03e52abd3dfb57fb6df125fda37d5fe1',container_format='bare',created_at=2026-05-13T04:15:12Z,direct_url=<?>,disk_format='qcow2',id=25dfae37-d72d-4a62-b40e-316c23c5864d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1405985100-shelved',owner='94e441f4e3754f1692b7d4b86c603ca8',properties=ImageMetaProps,protected=<?>,size=53936128,status='active',tags=<?>,updated_at=2026-05-13T04:15:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'dd0d182d-62d3-4878-8fcb-b987cdbb5e1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'serial': 'c42af889-1c22-4787-a8c8-40f034c5cdbe'}, 'disk_bus': 'virtio', 'attachment_id': '4ca6a074-d857-4fcb-acc8-58c4a50e4db7', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:47.289566 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:47.291303 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1405985100', uuid='dd0d182d-62d3-4878-8fcb-b987cdbb5e1f'), owner=OwnerMeta(userid='7cf2542ae398407abdb47a235f3c8505', username='tempest-AttachVolumeShelveTestJSON-173127407-project-member', projectid='94e441f4e3754f1692b7d4b86c603ca8', projectname='tempest-AttachVolumeShelveTestJSON-173127407'), image=ImageMeta(id='25dfae37-d72d-4a62-b40e-316c23c5864d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645747.2906065) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:47.294616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:47.295394 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:47.297950 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:47.298411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:47.300084 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:47.302431 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='03e52abd3dfb57fb6df125fda37d5fe1',container_format='bare',created_at=2026-05-13T04:15:12Z,direct_url=<?>,disk_format='qcow2',id=25dfae37-d72d-4a62-b40e-316c23c5864d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1405985100-shelved',owner='94e441f4e3754f1692b7d4b86c603ca8',properties=ImageMetaProps,protected=<?>,size=53936128,status='active',tags=<?>,updated_at=2026-05-13T04:15:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:47.302695 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:47.302844 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:47.303007 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:47.303161 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:47.303310 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:47.303673 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:47.303770 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:47.303954 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:47.304102 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:47.304296 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:47.304590 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:47.344601 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:47.412877 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:47.413082 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'keypairs' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:47.492267 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:15:47.501474 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-changed-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:47.501640 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Refreshing instance network info cache due to event network-changed-7d8ac866-d67a-4f7a-90ab-f456b3f1face. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:47.501823 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] Acquiring lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:47.501956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] Acquired lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:47.502095 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Refreshing network info cache for port 7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:47.577077 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:47.588678 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Successfully created port: e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:15:47.796231 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Updating instance_info_cache with network_info: [{"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:47.807241 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:47.824222 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:15:47.824628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:47.824803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:47.825213 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:47.825459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:15:47.842091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:47.842808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:47.847085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:47.847722 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:47.848749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:47.848927 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:47.865399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:47.865399 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:47.868203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:47.868203 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:47.882973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe] added
May 13 04:15:47.882973 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:47.882973 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:47.882973 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:47.882973 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:47.882973 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:47.882973 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:47.883240 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:47.884080 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:47.884080 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:47.884190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe] added
May 13 04:15:47.884190 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:47.884190 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:47.884190 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:47.884190 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:47.884190 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:47.884190 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:47.884410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:47.884449 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:47.884555 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:47.921119 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:47.922966 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:47.998942 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:15:48.007846 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:48.115969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Starting finish_migration {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 04:15:48.117487 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:15:48.117487 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Creating image(s)
May 13 04:15:48.117658 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:15:48.117816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Ensure instance console log exists: /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:48.118352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:48.118352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:48.118530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:48.119400 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start _get_guest_xml network_info=[{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c527a60e-fb33-4b05-a851-91c95ebe0c8e', 'attached_at': '2026-05-13T04:15:47.000000', 'detached_at': '', 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'serial': '606202ab-eaef-470a-af9d-f47457694f8b'}, 'disk_bus': 'virtio', 'attachment_id': '077bf7f3-3d53-41dc-9ebc-bec42aec5990', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:48.125885 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:48.126911 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2304711', uuid='c527a60e-fb33-4b05-a851-91c95ebe0c8e'), owner=OwnerMeta(userid='7cffc8fad0694442ad05ced625bbe1ad', username='tempest-ServerActionsTestOtherA-1572513959-project-member', projectid='03c2202127ca4ec4a872d2af2f5e4576', projectname='tempest-ServerActionsTestOtherA-1572513959'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645748.126634) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:48.129366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:48.129976 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:48.130493 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:48.130857 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:48.131370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:48.131624 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:48.131724 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:48.131822 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:48.131935 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:48.131998 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:48.132217 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:48.132317 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:48.132413 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:48.133160 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:48.133308 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:48.133447 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:48.142826 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:48.236373 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Successfully updated port: e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:15:48.242418 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Creating config drive at /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config.rescue
May 13 04:15:48.248743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:48.249240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:48.249531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:48.250212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:48.250628 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:15:48.251102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:48.251268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:48.252164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkgsara55 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:48.299791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Releasing lock "refresh_cache-d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:48.300521 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance network_info: |[{"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:48.308522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Start _get_guest_xml network_info=[{"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:48.308522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkgsara55" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:48.322152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-changed-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:48.322152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Refreshing instance network info cache due to event network-changed-e72020fc-4ee8-4b84-b1e9-ef35713d8f84. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:48.322152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] Acquiring lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:48.322152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] Acquired lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:48.322152 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Refreshing network info cache for port e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:48.331254 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:48.332716 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-629842023', uuid='d25a6ded-e4d5-4fcd-83f8-e5529244bcd7'), owner=OwnerMeta(userid='04922e90c12c49569c5ef4bd0c667e0c', username='tempest-VolumesActionsTest-863508426-project-member', projectid='d845c7c9f6c54bcd93149d01872b0a43', projectname='tempest-VolumesActionsTest-863508426'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645748.33225) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:48.337806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:48.337806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:48.339587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:48.339762 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:48.340919 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:48.341349 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:48.341493 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:48.341596 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:48.341707 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:48.341785 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:48.341870 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:48.342079 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:48.342207 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:48.342918 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:48.345703 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:48.345703 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:48.362973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d04e551b-4c97-4d98-9fa4-11fa734d625b req-d9b64ff1-cafc-43ce-980b-d149333432f5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-deleted-a27f493a-1be2-4677-9033-522c612e83fe {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:48.362973 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-d04e551b-4c97-4d98-9fa4-11fa734d625b req-d9b64ff1-cafc-43ce-980b-d149333432f5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Neutron deleted interface a27f493a-1be2-4677-9033-522c612e83fe; detaching it from the instance and deleting it from the info cache
May 13 04:15:48.362973 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d04e551b-4c97-4d98-9fa4-11fa734d625b req-d9b64ff1-cafc-43ce-980b-d149333432f5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [{"id": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "address": "fa:16:3e:45:30:d0", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ba483c-84", "ovs_interfaceid": "39ba483c-84d3-4d58-b954-bb146bb3ced1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "651fc391-a28c-43c4-b10b-3c85424f6550", "address": "fa:16:3e:88:a3:a5", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap651fc391-a2", "ovs_interfaceid": "651fc391-a28c-43c4-b10b-3c85424f6550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbee0585-5bcd-474c-aec6-3a53564ab617", "address": "fa:16:3e:8f:f8:52", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbee0585-5b", "ovs_interfaceid": "bbee0585-5bcd-474c-aec6-3a53564ab617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f630024b-f368-4240-a2da-7de17c078e39", "address": "fa:16:3e:36:b2:00", "network": {"id": "75ac3a98-11f5-4197-b4d5-b32a13490076", "bridge": "br-int", "label": "tempest-device-tagging-net1-1857802995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf630024b-f3", "ovs_interfaceid": "f630024b-f368-4240-a2da-7de17c078e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "address": "fa:16:3e:2c:bb:21", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb63e16b-32", "ovs_interfaceid": "fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "address": "fa:16:3e:44:d0:51", "network": {"id": "f51de565-dcc4-499c-a47b-cb13152391fc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1907607739", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f6c259b2e604721a8cd6997f2d51f08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11142b22-dc", "ovs_interfaceid": "11142b22-dcac-4d65-9aa2-81ea9d7943c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:48.373840 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629842023',display_name='tempest-VolumesActionsTest-instance-629842023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-629842023',id=23,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-l8ilzs2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:45Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d25a6ded-e4d5-4fcd-83f8-e5529244bcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:48.374567 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:48.375148 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:48.376813 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lazy-loading 'pci_devices' on Instance uuid d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:48.505588 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Booting with volume-backed-image 21f6dd9f-a6e8-4103-9a88-7de2ff01268f at /dev/vda
May 13 04:15:48.572351 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:48.743725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:48.752516 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updated VIF entry in instance network info cache for port 7d8ac866-d67a-4f7a-90ab-f456b3f1face. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:15:48.752799 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating instance_info_cache with network_info: [{"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:48.814826 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.827132 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:48.842230 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.844120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.871384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d04e551b-4c97-4d98-9fa4-11fa734d625b req-d9b64ff1-cafc-43ce-980b-d149333432f5 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Detach interface failed, port_id=a27f493a-1be2-4677-9033-522c612e83fe, reason: Instance 51569bed-8bc3-4c71-97b6-81cf863c0f4c could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:15:48.883475 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <uuid>d25a6ded-e4d5-4fcd-83f8-e5529244bcd7</uuid>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <name>instance-00000017</name>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesActionsTest-instance-629842023</nova:name>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:48</nova:creationTime>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:user uuid="04922e90c12c49569c5ef4bd0c667e0c">tempest-VolumesActionsTest-863508426-project-member</nova:user>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:project uuid="d845c7c9f6c54bcd93149d01872b0a43">tempest-VolumesActionsTest-863508426</nova:project>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         <nova:port uuid="cfe49895-aefa-495c-8b80-9085d149a449">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="serial">d25a6ded-e4d5-4fcd-83f8-e5529244bcd7</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="uuid">d25a6ded-e4d5-4fcd-83f8-e5529244bcd7</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.config"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:83:b1:32"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <target dev="tapcfe49895-ae"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/console.log" append="off"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:48.883475 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:48.885162 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Preparing to wait for external event network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:48.885162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:48.885162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:48.885162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:48.889289 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629842023',display_name='tempest-VolumesActionsTest-instance-629842023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-629842023',id=23,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-l8ilzs2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:45Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d25a6ded-e4d5-4fcd-83f8-e5529244bcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:48.889289 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:48.889289 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:48.889289 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:48.889289 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:48.889642 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:48.892493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.893047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:48.893340 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:48.894431 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.894648 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c9bf5a8-3d33-55a2-9c27-29ee450d32e0', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:48.898018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.898018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:48.898018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.903107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.903404 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfe49895-ae, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:48.906349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfe49895-ae, col_values=(('qos', UUID('b1a87e70-80aa-4f27-82b1-e08b465ede47')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:48.906349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfe49895-ae, col_values=(('external_ids', {'iface-id': 'cfe49895-aefa-495c-8b80-9085d149a449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:b1:32', 'vm-uuid': 'd25a6ded-e4d5-4fcd-83f8-e5529244bcd7'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:48.906349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.906935 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:48.909021 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:48.909021 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:48.911907 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:48.911907 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:48.914903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.916271 np0000000669 nova-compute[97951]: INFO os_vif [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae')
May 13 04:15:48.931347 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:48.937273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:48.940424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:48.960163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.960163 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.960163 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.960163 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.960163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:48.960384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.960384 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.960384 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.960384 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.960384 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:48.962813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.962813 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.962813 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.962813 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.962813 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:48.962954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.962954 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:48.962954 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.962954 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:48.962954 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:48.966682 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.984525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:48.991654 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:49.004586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.50.100,3260]
May 13 04:15:49.004586 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.50.100,3260] successful.
May 13 04:15:49.004586 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:49.011558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.40.100,3260]
May 13 04:15:49.011558 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.40.100,3260] successful.
May 13 04:15:49.011558 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:49.022404 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:49.028083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.040861 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.041093 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:49.041547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:49.041718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:49.045586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] HCTL ('7', '-', '-', 0) found on session 41 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:49.045586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.046464 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:49.046695 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:49.046904 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:49.046983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:49.048556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] HCTL ('8', '-', '-', 0) found on session 42 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:49.048556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:49.067920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching for a device in session 41 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:49.067920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:49.083855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching for a device in session 42 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:49.084096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:49.255200 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-45e25fd8-fd8a-4015-9cf4-768a2d539098 req-505365a3-7a25-4f47-8477-60d5e413180a service nova] Releasing lock "refresh_cache-d2031784-5e1a-4659-9673-b16764bf8111" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:49.265006 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:49.291851 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:49.473749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:49.566401 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e353bf6-3d22-4dcd-a4c7-6a0a02a74d9f req-2ba9db20-f8ca-44f2-a761-d377680c59c7 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-deleted-fb63e16b-32c5-46fe-aceb-9f7c7a3a98f6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:49.566833 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3e353bf6-3d22-4dcd-a4c7-6a0a02a74d9f req-2ba9db20-f8ca-44f2-a761-d377680c59c7 service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-deleted-f630024b-f368-4240-a2da-7de17c078e39 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:49.769712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4989672f-e9b0-4f49-9f03-07c3576d701e req-a544177b-f862-4cf6-ac9c-1099deac8b4c service nova] Releasing lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:49.769980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:49.770187 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:49.795896 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Took 3.91 seconds to deallocate network for instance.
May 13 04:15:49.844263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:15:49.848155 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 0c26601c-8a4a-49fd-bb81-a146023d95fb due to new event <LifecycleEvent: 1778645749.8477619, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:15:49.848363 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645749.8477619, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:49.848492 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Resumed (Lifecycle Event)
May 13 04:15:49.853496 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-26899d72-99cf-45be-8b4e-82d3c4dff9ea tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:50.353489 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:15:50.356457 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:50.359899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:50.404783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da0d31c8-f3c7-4a1e-aec9-284c1a7159e1 req-d8d20352-bcb1-4c4f-acb0-5152828025da service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-deleted-bbee0585-5bcd-474c-aec6-3a53564ab617 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:50.404865 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da0d31c8-f3c7-4a1e-aec9-284c1a7159e1 req-d8d20352-bcb1-4c4f-acb0-5152828025da service nova] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Received event network-vif-deleted-11142b22-dcac-4d65-9aa2-81ea9d7943c1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state None.
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:50.453131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:50.453697 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-786a2bd4-c27f-48a0-9a5a-ded8d020ada6 req-19ae5dd8-aa4d-42a7-90ba-2ace608c18e3 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state None.
May 13 04:15:50.455541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:50.455794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:50.456194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No VIF found with MAC fa:16:3e:83:b1:32, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:50.458206 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Using config drive
May 13 04:15:50.574734 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:50.734643 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:50.863926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Found WWN 330000000f8713fb5 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:15:50.863926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:50.863926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000f8713fb5', 'path': '/dev/dm-0', 'multipath_id': '330000000f8713fb5'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:50.863926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f8713fb5', 'path': '/dev/dm-0', 'multipath_id': '330000000f8713fb5'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:15:50.864388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.613s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:50.864665 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:15:50.873508 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645750.8722432, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:50.873508 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Started (Lifecycle Event)
May 13 04:15:50.882733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:50.884450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:50.884987 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:50.885505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:50.885898 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:50.886229 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:50.898452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:50.898452 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:50.905770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:50.905770 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:50.913286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b] added
May 13 04:15:50.913286 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:50.913286 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:50.913286 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:50.913286 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:50.913286 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:50.913286 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:50.913653 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:50.913768 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:50.913989 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:50.920540 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b] added
May 13 04:15:50.920540 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:50.920540 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:50.920540 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:50.920540 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:50.920540 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:50.920540 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:50.920868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:50.920868 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:50.921097 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:50.966871 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:51.105062 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Creating config drive at /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.config
May 13 04:15:51.108112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpohzaj8yu {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:51.156785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpohzaj8yu" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:51.239954 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:51.240592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance network_info: |[{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:15:51.360713 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Unrescuing
May 13 04:15:51.361171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:51.361171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:51.364569 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:15:51.377627 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='25dfae37-d72d-4a62-b40e-316c23c5864d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-792508241',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:24Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:15:19.682040',shelved_host='np0000000669',shelved_image_id='25dfae37-d72d-4a62-b40e-316c23c5864d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:51.377627 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:51.377627 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:51.377627 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_devices' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:51.379084 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:51.383056 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:51.512955 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Took 1.72 seconds to detach 3 volumes for instance.
May 13 04:15:51.628875 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.664618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.780439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.852705 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-515d5e82-3749-4133-99d8-f6399ca8342c req-d45db71c-5652-4ecf-81fe-67200a0848f5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:51.852940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-515d5e82-3749-4133-99d8-f6399ca8342c req-d45db71c-5652-4ecf-81fe-67200a0848f5 service nova] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:51.853127 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-515d5e82-3749-4133-99d8-f6399ca8342c req-d45db71c-5652-4ecf-81fe-67200a0848f5 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:51.853261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-515d5e82-3749-4133-99d8-f6399ca8342c req-d45db71c-5652-4ecf-81fe-67200a0848f5 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:51.853418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-515d5e82-3749-4133-99d8-f6399ca8342c req-d45db71c-5652-4ecf-81fe-67200a0848f5 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Processing event network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:51.867479 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:51.887109 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:51.888013 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <uuid>dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</uuid>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <name>instance-0000000f</name>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1405985100</nova:name>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:47</nova:creationTime>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:user uuid="7cf2542ae398407abdb47a235f3c8505">tempest-AttachVolumeShelveTestJSON-173127407-project-member</nova:user>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:project uuid="94e441f4e3754f1692b7d4b86c603ca8">tempest-AttachVolumeShelveTestJSON-173127407</nova:project>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         <nova:port uuid="7fe4fce9-6847-4bd4-8178-cb1962e7a63d">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="serial">dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="uuid">dd0d182d-62d3-4878-8fcb-b987cdbb5e1f</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <alias name="ua-c42af889-1c22-4787-a8c8-40f034c5cdbe"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <target dev="vdc" bus="virtio"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <serial>c42af889-1c22-4787-a8c8-40f034c5cdbe</serial>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:b1:31:d9"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <target dev="tap7fe4fce9-68"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/console.log" append="off"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:51.892302 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Preparing to wait for external event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='25dfae37-d72d-4a62-b40e-316c23c5864d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-792508241',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:24Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:15:19.682040',shelved_host='np0000000669',shelved_image_id='25dfae37-d72d-4a62-b40e-316c23c5864d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:51.892302 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:51.895629 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.895629 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:51.895629 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:51.899173 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.899173 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4de3db10-8b90-5c7d-bea5-c3369f07fe0c', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:51.902508 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.904251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:51.907308 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.907533 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fe4fce9-68, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:51.909237 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fe4fce9-68, col_values=(('qos', UUID('e7e767af-598f-4d44-aacd-9f2bc74b1b52')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:51.909237 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fe4fce9-68, col_values=(('external_ids', {'iface-id': '7fe4fce9-6847-4bd4-8178-cb1962e7a63d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:31:d9', 'vm-uuid': 'dd0d182d-62d3-4878-8fcb-b987cdbb5e1f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:51.912105 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.912105 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:51.915628 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:51.918474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:51.919772 np0000000669 nova-compute[97951]: INFO os_vif [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68')
May 13 04:15:51.922308 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:51.933967 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:51.933967 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:51.941445 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:51.941445 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:51.956371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:51.960726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.977762 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.977942 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.978699 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:51.978926 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:52.024866 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:52.028297 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:52.030575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260]
May 13 04:15:52.030575 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260] successful.
May 13 04:15:52.030575 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:52.035416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:52.038151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260]
May 13 04:15:52.038151 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260] successful.
May 13 04:15:52.038151 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:52.043132 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:52.063078 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:52.070185 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:52.077497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.084825 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.085306 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:52.085716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:52.085716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:52.085965 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:52.088389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('11', '-', '-', 0) found on session 43 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:52.088574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:52.114164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:52.121022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:52.123091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:52.123091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 43 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:52.123091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:52.126465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] HCTL ('12', '-', '-', 0) found on session 44 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:52.126465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:52.157115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Searching for a device in session 44 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:52.157115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:52.165617 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:52.184138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:15:52.225094 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:52.292469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:15:52.292670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:15:52.303798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:15:52.307045 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:fe83:b132', 'fe80::d86f:96ff:fe30:826'] 
May 13 04:15:52.307348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:15:52.307403 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:15:52.307734 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:52.307994 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating existing volume attachment record: fe581fd0-fd6f-49d2-997d-ba11df8bb28d {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:15:52.458174 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:52.677783 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:52.817865 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:52.818456 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645752.8179545, d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:52.818641 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] VM Started (Lifecycle Event)
May 13 04:15:52.820521 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:52.824418 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance spawned successfully.
May 13 04:15:52.827877 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:15:52.886692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:15:53.109362 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:15:53.109605 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:15:53.179976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:15:53.180662 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'flavor' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:53.322408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:53.326281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:53.333529 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.333980 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.334562 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.334674 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.335444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.335748 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:15:53.458977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:53.459489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:53.459489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:53.459611 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No VIF found with MAC fa:16:3e:b1:31:d9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:53.460307 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Using config drive
May 13 04:15:53.612758 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:15:53.720483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:53.724585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:53.753202 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:53.841445 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:15:53.841445 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Took 8.11 seconds to spawn the instance on the hypervisor.
May 13 04:15:53.841445 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:53.841716 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645753.8413866, d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:53.841769 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] VM Paused (Lifecycle Event)
May 13 04:15:53.877795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:53.892515 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:53.919482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Found WWN 330000000ddfccc09 for multipath device dm-2 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:15:53.920005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:53.920277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== connect_volume: return (5668ms) {'type': 'block', 'scsi_wwn': '330000000ddfccc09', 'path': '/dev/dm-2', 'multipath_id': '330000000ddfccc09'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:53.920482 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ddfccc09', 'path': '/dev/dm-2', 'multipath_id': '330000000ddfccc09'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:15:53.935769 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:53.936178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:53.936540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:53.936540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:53.936850 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:53.936913 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-f5c4d0e3-8904-4b62-9fe0-f216f3999e7e req-a80b1f53-ee54-4323-ae71-2069457c7743 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state unrescuing.
May 13 04:15:53.951885 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:53.952557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:53.952709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:53.952841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:53.953019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] No waiting events found dispatching network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:53.953156 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fe729f34-7699-4ccc-9e2e-2adb177b1522 req-d98e7752-4501-45cc-a17a-191fa276ad63 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received unexpected event network-vif-plugged-cfe49895-aefa-495c-8b80-9085d149a449 for instance with vm_state active and task_state None.
May 13 04:15:53.963523 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'ec2_ids' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:54.043768 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance destroyed successfully.
May 13 04:15:54.044683 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:54.122845 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.096s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:54.175523 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Deleted allocations for instance 51569bed-8bc3-4c71-97b6-81cf863c0f4c
May 13 04:15:54.344472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:54.346366 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645754.3461013, d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:54.346593 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] VM Resumed (Lifecycle Event)
May 13 04:15:54.362068 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Took 22.39 seconds to build instance.
May 13 04:15:54.430597 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:54.431154 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:54.432740 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:54.435705 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <uuid>c527a60e-fb33-4b05-a851-91c95ebe0c8e</uuid>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <name>instance-00000013</name>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <memory>262144</memory>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherA-server-2304711</nova:name>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:48</nova:creationTime>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.micro" id="84">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:memory>256</nova:memory>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:user uuid="7cffc8fad0694442ad05ced625bbe1ad">tempest-ServerActionsTestOtherA-1572513959-project-member</nova:user>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:project uuid="03c2202127ca4ec4a872d2af2f5e4576">tempest-ServerActionsTestOtherA-1572513959</nova:project>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         <nova:port uuid="1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="serial">c527a60e-fb33-4b05-a851-91c95ebe0c8e</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="uuid">c527a60e-fb33-4b05-a851-91c95ebe0c8e</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/disk.config"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <alias name="ua-606202ab-eaef-470a-af9d-f47457694f8b"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-2"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <serial>606202ab-eaef-470a-af9d-f47457694f8b</serial>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a7:d9:5a"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <target dev="tap1f7bcbc4-b0"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e/console.log" append="off"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:54.435705 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:54.439183 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:54.439183 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1075683288-network", "vif_mac": "fa:16:3e:a7:d9:5a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:54.439183 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:54.439183 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:54.439906 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.440244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:54.440565 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:54.442063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.442263 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '081596de-c7b9-5e78-a3c0-50ffeea5d149', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:54.443178 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.443937 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:54.455605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.458163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.458385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7bcbc4-b0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:54.458777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7bcbc4-b0, col_values=(('qos', UUID('dcae3298-17ce-4aec-acb9-fb4a4775ae51')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:54.459002 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7bcbc4-b0, col_values=(('external_ids', {'iface-id': '1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:d9:5a', 'vm-uuid': 'c527a60e-fb33-4b05-a851-91c95ebe0c8e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:54.460752 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.462921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:54.469101 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:54.471516 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'keypairs' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:54.481065 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:54.484609 np0000000669 nova-compute[97951]: INFO os_vif [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0')
May 13 04:15:54.495237 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:15:54.498930 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:15:54.499411 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Creating image(s)
May 13 04:15:54.499737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:15:54.500445 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Ensure instance console log exists: /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:15:54.500445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:54.500445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:54.500445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:54.501023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start _get_guest_xml network_info=[{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0f5d5e68-798e-4ec5-ade4-5146c9032019', 'attached_at': '', 'detached_at': '', 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'serial': '084b2bf2-b3ae-4a66-9d82-8793e064204d'}, 'disk_bus': 'virtio', 'attachment_id': 'fe581fd0-fd6f-49d2-997d-ba11df8bb28d', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:15:54.504306 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:15:54.506047 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456', uuid='0f5d5e68-798e-4ec5-ade4-5146c9032019'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645754.5053673) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:15:54.508666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:15:54.509344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:15:54.511208 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:15:54.511443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:15:54.512548 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:15:54.512812 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:15:54.513060 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:15:54.513222 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:15:54.513409 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:15:54.513532 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:15:54.513666 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:15:54.514128 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:15:54.514128 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:15:54.514226 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:15:54.514338 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:15:54.514514 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:15:54.527692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:15:54.528052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:15:54.528179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:54.531350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:54.531350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:15:54.541145 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:54.541666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:54.541902 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:54.542375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:15:54.542664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:15:54.542816 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:54.546990 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Object Instance<0c26601c-8a4a-49fd-bb81-a146023d95fb> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:54.558435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:54.558435 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:54.565071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:15:54.565071 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:54.580913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d] added
May 13 04:15:54.580913 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:54.580913 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:54.580913 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:54.580913 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:54.580913 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:54.580913 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:54.581501 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:54.582177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d] added
May 13 04:15:54.582177 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:15:54.582177 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:54.582177 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:54.582177 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:15:54.582177 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:15:54.582177 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:54.582460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:15:54.582608 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:54.583380 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:15:54.583380 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:54.583633 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:15:54.849131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:54.854971 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:54.869356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.904s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:54.977352 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<dd0d182d-62d3-4878-8fcb-b987cdbb5e1f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:15:54.979019 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:55.123131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.160116 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.168974 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.173383 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Creating config drive at /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config
May 13 04:15:55.180418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3opax7cr {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:15:55.207194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0cbbf913-17d4-49ce-8f79-b59a4f6f4a73 tempest-TaggedBootDevicesTest-458067948 tempest-TaggedBootDevicesTest-458067948-project-member] Lock "51569bed-8bc3-4c71-97b6-81cf863c0f4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.179s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:55.235343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3opax7cr" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:15:55.293720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.310654 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.329306 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.358874 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999631188999956 future=<Future at 0x7a463c3418b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.583711 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:15:55.584307 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:55.602629 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:55.602629 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.607069 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.005151828999942154 future=<Future at 0x7a463c154200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.607069 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.607069 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.8914120249999087 future=<Future at 0x7a463c176e70 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.607069 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.891321711000046 future=<Future at 0x7a463c176e70 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.608128 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.608128 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.812585334000005 future=<Future at 0x7a463c0fdc40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.610467 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.811861616999977 future=<Future at 0x7a463c0fdc40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:55.611256 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Emitting event <LifecycleEvent: 1778645740.6015122, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:55.611531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Stopped (Lifecycle Event)
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:15:55.613815 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:15:55.613815 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.624080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.634259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.645533 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.645890 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.658430 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:55.705564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.40.100,3260]
May 13 04:15:55.705564 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.40.100,3260] successful.
May 13 04:15:55.705564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.713791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.50.100,3260]
May 13 04:15:55.713791 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.50.100,3260] successful.
May 13 04:15:55.713791 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.724041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.732088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.746934 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.747317 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:55.747605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:55.747730 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:55.749259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('15', '-', '-', 0) found on session 45 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:55.749517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.754855 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:15:55.755224 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:15:55.755573 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:55.755752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:15:55.758135 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('16', '-', '-', 0) found on session 46 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:15:55.758657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:15:55.771695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:55.783622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:55.869956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:55.934308 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.019691 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:56.019926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:15:56.020137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] No VIF found with MAC fa:16:3e:a7:d9:5a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:15:56.020830 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Using config drive
May 13 04:15:56.080960 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.118482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:56.255232 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:56.255232 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:56.256529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state unrescuing.
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state unrescuing.
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:56.259231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:56.259912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:56.259912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:56.261267 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:56.261267 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-1e442e9a-5ee2-4110-86ad-aa2c078afbb7 req-c0402050-9650-419c-8cbb-30ddff9aa07b service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received unexpected event network-vif-plugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with vm_state rescued and task_state unrescuing.
May 13 04:15:56.415021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.430161 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.438571 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.472526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.483183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.682103 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:56.682687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:56.682687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:56.682687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:56.682822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:56.685068 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Terminating instance
May 13 04:15:56.701053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.734086 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.770287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:56.771086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:56.785742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:15:56.786015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:15:56.848899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.876641 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:56.962423 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 0c26601c-8a4a-49fd-bb81-a146023d95fb due to new event <LifecycleEvent: 1778645756.9603732, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:15:56.962577 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645756.9603732, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:56.962786 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Resumed (Lifecycle Event)
May 13 04:15:56.966650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d1210b6-9b02-4b81-beb5-4434ff037058 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:57.191333 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:15:57.217736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.220541 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.247589 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.249057 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.278838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.442827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.469031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:57.475684 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:57.544300 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:57.548476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:57.548897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:57.549252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:57.549804 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] No waiting events found dispatching network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:57.550106 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a29a16b9-0e83-4940-8e58-8da1aa734180 req-a55a12cd-df92-4386-bc8c-6538dfae8f49 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:57.551213 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:15:57.604007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.615121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:57.642007 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Instance destroyed successfully.
May 13 04:15:57.642489 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lazy-loading 'resources' on Instance uuid d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:57.985430 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645757.9849343, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:57.987934 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Started (Lifecycle Event)
May 13 04:15:58.112354 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:58.114854 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance running successfully.
May 13 04:15:58.115834 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Failed to set time: agent not configured {{(pid=97951) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 04:15:58.116008 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2e36fbf5-52de-4d16-bfbe-f96c2528ce49 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] finish_migration finished successfully. {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 04:15:58.154404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629842023',display_name='tempest-VolumesActionsTest-instance-629842023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-629842023',id=23,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:53Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-l8ilzs2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:54Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d25a6ded-e4d5-4fcd-83f8-e5529244bcd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:15:58.154711 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "cfe49895-aefa-495c-8b80-9085d149a449", "address": "fa:16:3e:83:b1:32", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe49895-ae", "ovs_interfaceid": "cfe49895-aefa-495c-8b80-9085d149a449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:58.155185 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:58.155467 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:15:58.156993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.160291 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfe49895-ae, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:58.161501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.162456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:58.163161 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.163687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.163836 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1a87e70-80aa-4f27-82b1-e08b465ede47) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:58.166972 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.167602 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:58.167769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:58.170271 np0000000669 nova-compute[97951]: INFO os_vif [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=cfe49895-aefa-495c-8b80-9085d149a449,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe49895-ae')
May 13 04:15:58.170645 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Deleting instance files /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7_del
May 13 04:15:58.171493 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Deletion of /opt/stack/data/nova/instances/d25a6ded-e4d5-4fcd-83f8-e5529244bcd7_del complete
May 13 04:15:58.352071 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:58.352071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:58.352071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Processing event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received unexpected event network-vif-plugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with vm_state shelved_offloaded and task_state spawning.
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:58.353605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:58.354368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:58.354368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:58.354368 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:58.354368 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received unexpected event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with vm_state active and task_state resize_finish.
May 13 04:15:58.354549 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:58.354590 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:58.354750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:58.354903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:58.355044 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:58.355257 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2596b0aa-85d6-4e44-a09a-23f47fe26c3a req-f28ae404-6833-4e3a-8fd2-9d9c00a09c1b service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received unexpected event network-vif-plugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with vm_state active and task_state resize_finish.
May 13 04:15:58.355840 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:15:58.365977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:15:58.368432 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance spawned successfully.
May 13 04:15:58.490347 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:58.497194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:58.572642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Found WWN 330000000cdfa9ca1 for multipath device dm-5 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:15:58.573102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.044s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:15:58.573412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': '330000000cdfa9ca1', 'path': '/dev/dm-5', 'multipath_id': '330000000cdfa9ca1'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:15:58.573909 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cdfa9ca1', 'path': '/dev/dm-5', 'multipath_id': '330000000cdfa9ca1'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:15:58.685819 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Took 1.49 seconds to destroy the instance on the hypervisor.
May 13 04:15:58.686708 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:15:58.687541 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:15:58.687697 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:15:58.688053 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:58.852098 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:58.887928 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:15:59.002161 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999704984000118 future=<Future at 0x7a463c1544a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.002667 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645759.002175, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:59.002667 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Started (Lifecycle Event)
May 13 04:15:59.083520 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643698456',id=24,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-vndc5wzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:48Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=0f5d5e68-798e-4ec5-ade4-5146c9032019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:15:59.083520 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:59.085037 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:59.087386 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:15:59.364945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-29d96315-b175-43f3-acc1-d7038bfba172 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.618s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:59.420274 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00038799999992988887 future=<Future at 0x7a463c0fdc40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.420873 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Emitting event <LifecycleEvent: 1778645744.4197686, 51569bed-8bc3-4c71-97b6-81cf863c0f4c => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:15:59.421026 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.421255 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] VM Stopped (Lifecycle Event)
May 13 04:15:59.422084 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.93655448100003 future=<Future at 0x7a463c3418b0 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.422681 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.935824211999943 future=<Future at 0x7a463c3418b0 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.422908 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.423913 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.578824189999978 future=<Future at 0x7a463c1544a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.423913 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.578706946000011 future=<Future at 0x7a463c1544a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:15:59.484153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.506898 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:15:59.514524 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:15:59.594295 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] End _get_guest_xml xml=<domain type="qemu">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <uuid>0f5d5e68-798e-4ec5-ade4-5146c9032019</uuid>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <name>instance-00000018</name>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1643698456</nova:name>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:15:54</nova:creationTime>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         <nova:port uuid="e72020fc-4ee8-4b84-b1e9-ef35713d8f84">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <system>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="serial">0f5d5e68-798e-4ec5-ade4-5146c9032019</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="uuid">0f5d5e68-798e-4ec5-ade4-5146c9032019</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </system>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <os>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </os>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <features>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </features>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   <devices>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <alias name="ua-084b2bf2-b3ae-4a66-9d82-8793e064204d"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-5"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <serial>084b2bf2-b3ae-4a66-9d82-8793e064204d</serial>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </disk>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:87:4e:1e"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <target dev="tape72020fc-4e"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </interface>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/console.log" append="off"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </serial>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <video>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </video>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </rng>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:   </devices>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]: </domain>
May 13 04:15:59.594295 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:15:59.597991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Preparing to wait for external event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:15:59.597991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:59.597991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:59.597991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:59.598460 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643698456',id=24,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-vndc5wzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:15:48Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=0f5d5e68-798e-4ec5-ade4-5146c9032019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:15:59.598460 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:15:59.599055 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:15:59.599333 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:15:59.599861 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.600155 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:59.600457 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:15:59.601513 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.601770 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ab2ba02-136c-5683-9237-3ac04b0de958', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:59.602688 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.603519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:59.603850 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.608775 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.608991 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72020fc-4e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:59.609357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape72020fc-4e, col_values=(('qos', UUID('b6114153-9440-4282-adfb-c4d29e6ba88e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:59.609562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape72020fc-4e, col_values=(('external_ids', {'iface-id': 'e72020fc-4ee8-4b84-b1e9-ef35713d8f84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4e:1e', 'vm-uuid': '0f5d5e68-798e-4ec5-ade4-5146c9032019'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:15:59.610716 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.613984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:15:59.618628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:15:59.619871 np0000000669 nova-compute[97951]: INFO os_vif [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e')
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Acquiring lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] No waiting events found dispatching network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:15:59.632973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-unplugged-cfe49895-aefa-495c-8b80-9085d149a449 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:15:59.633439 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:15:59.634018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing instance network info cache due to event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:15:59.636171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:15:59.636171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:15:59.636171 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:15:59.692982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:15:59.693197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:15:59.693317 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Going to confirm migration 1 {{(pid=97951) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 04:15:59.716568 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:15:59.924164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 51569bed-8bc3-4c71-97b6-81cf863c0f4c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:00.017946 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645760.0166435, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:00.017946 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Paused (Lifecycle Event)
May 13 04:16:00.137931 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:00.210900 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:00.220814 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Took 1.53 seconds to deallocate network for instance.
May 13 04:16:00.350067 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:00.350067 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:00.350231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquired lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:00.352388 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:00.353305 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'info_cache' on Instance uuid c527a60e-fb33-4b05-a851-91c95ebe0c8e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:00.440677 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-239011e9-b9e3-49c0-aef7-cab488e47f68 req-797a0ae4-dffd-4711-bf98-096f453f2a58 service nova] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Received event network-vif-deleted-cfe49895-aefa-495c-8b80-9085d149a449 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:00.519972 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:00.524961 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645760.524574, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:00.525919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Resumed (Lifecycle Event)
May 13 04:16:00.558369 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:00.727828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:00.727971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:00.736235 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updated VIF entry in instance network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:16:00.736538 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:01.030308 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:01.032287 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:01.149155 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:01.149373 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:01.149534 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:87:4e:1e, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:01.150142 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Using config drive
May 13 04:16:01.239847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:01.240061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:01.240221 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing instance network info cache due to event network-changed-1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:16:01.240524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Acquiring lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:01.240795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Acquired lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:01.241429 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Refreshing network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:16:01.358005 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:01.539672 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645761.5383024, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:01.539672 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Started (Lifecycle Event)
May 13 04:16:01.612503 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:01.612826 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:01.657455 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:01.745594 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:01.847965 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:01.903472 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Creating config drive at /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config
May 13 04:16:01.906862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmxbg8nhj {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:01.986563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmxbg8nhj" returned: 0 in 0.079s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:02.042792 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:02.045349 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:02.074414 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [{"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:02.116408 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:02.281001 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:02.473366 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updated VIF entry in instance network info cache for port 1f41e74f-330f-4a30-a571-bb4455851fa5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:16:02.476835 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [{"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:02.548861 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645762.5485067, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:02.549454 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Resumed (Lifecycle Event)
May 13 04:16:02.573547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:02.580767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Releasing lock "refresh_cache-c527a60e-fb33-4b05-a851-91c95ebe0c8e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:02.581679 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'migration_context' on Instance uuid c527a60e-fb33-4b05-a851-91c95ebe0c8e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:02.613452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:02.624931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.897s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:02.704074 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Deleted allocations for instance d25a6ded-e4d5-4fcd-83f8-e5529244bcd7
May 13 04:16:02.729441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:02.752475 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:02.752475 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:02.980832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-645e85ee-e8c6-4239-a2e4-4a4bd2432b4b req-21c96130-710e-4667-acba-21446205cdd4 service nova] Releasing lock "refresh_cache-0c26601c-8a4a-49fd-bb81-a146023d95fb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:02.998701 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-54e4c730-5b30-412e-add5-3296bb399117 req-f51b4757-3e8f-41e0-b3ea-d17d3bf8ec52 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:03.000116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-54e4c730-5b30-412e-add5-3296bb399117 req-f51b4757-3e8f-41e0-b3ea-d17d3bf8ec52 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:03.000116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-54e4c730-5b30-412e-add5-3296bb399117 req-f51b4757-3e8f-41e0-b3ea-d17d3bf8ec52 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:03.000116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-54e4c730-5b30-412e-add5-3296bb399117 req-f51b4757-3e8f-41e0-b3ea-d17d3bf8ec52 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:03.000116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-54e4c730-5b30-412e-add5-3296bb399117 req-f51b4757-3e8f-41e0-b3ea-d17d3bf8ec52 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Processing event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:16:03.058446 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:03.063649 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:03.107946 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Object Instance<c527a60e-fb33-4b05-a851-91c95ebe0c8e> lazy-loaded attributes: info_cache,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:03.109014 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:03.109204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:03.715797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c59bc68f-57d5-4894-89b3-191c50a15920 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d25a6ded-e4d5-4fcd-83f8-e5529244bcd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:03.756492 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:16:03.756492 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645763.7544973, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:03.756492 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Started (Lifecycle Event)
May 13 04:16:03.758557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:16:03.775807 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance spawned successfully.
May 13 04:16:03.775807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:16:03.935817 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:04.259242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:04.265017 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:04.295244 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.295465 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.295999 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.296415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.296856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.297310 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:04.490967 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:04.587056 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:04.587188 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:04.611048 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:04.772159 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:16:04.772492 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645764.7722468, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:04.772712 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Paused (Lifecycle Event)
May 13 04:16:04.813011 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Took 10.32 seconds to spawn the instance on the hypervisor.
May 13 04:16:04.813011 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:05.090778 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:05.113912 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:05.113912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:05.114190 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:05.114244 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:05.114479 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:05.116250 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-65b2ad20-24c5-4551-b1a7-565c2222efc1 req-5be864c8-94e5-4299-9d2e-0a13bf6ebbb4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state active and task_state None.
May 13 04:16:05.275844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:05.278455 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645765.278129, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:05.278682 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Resumed (Lifecycle Event)
May 13 04:16:05.327959 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Took 29.77 seconds to build instance.
May 13 04:16:05.488454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:05.488725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:05.781306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:05.786888 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:05.829741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47179d94-27cb-412e-9f0d-ecc10d827f9c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.289s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:05.992661 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:16:06.112347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:06.578449 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:06.578940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:06.583471 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:16:06.583899 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Claim successful on node np0000000669
May 13 04:16:06.732167 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Rescuing
May 13 04:16:06.732167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:06.732407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:06.732407 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:06.749943 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:06.805411 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Deleted allocation for migration 78e8a91f-d1db-40f2-babf-52a2127ac685
May 13 04:16:06.810078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:07.162649 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:07.313452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9fc0f1c2-1917-47c4-a536-3759f019cf15 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.620s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:07.394801 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:07.641170 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-61c6b9d7-22e0-4633-84c2-3b7c88925c6e tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Get console output
May 13 04:16:07.725219 np0000000669 nova-compute[97951]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 13 04:16:07.899953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:08.485816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:08.486038 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:08.573708 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:08.573708 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:08.989506 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:09.078810 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'flavor' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:09.489436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.497941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.919s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:09.498451 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:16:09.591899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.591899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.611965 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.746105 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.753315 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:09.906150 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999655644000086 future=<Future at 0x7a463c154440 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:09.907833 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance destroyed successfully.
May 13 04:16:09.909215 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:09.933236 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:09.933516 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:09.933997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:09.934110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:09.934357 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:09.934550 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e93f23f0-2733-4509-9a6e-d963612ebab9 req-d87f441d-f99b-4b20-8605-668c5fec2816 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state active and task_state rescuing.
May 13 04:16:10.005160 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:16:10.005808 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:16:10.006094 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:10.006401 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:10.096084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:10.152691 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04922e90c12c49569c5ef4bd0c667e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd845c7c9f6c54bcd93149d01872b0a43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:16:10.418079 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Attempting a stable device rescue
May 13 04:16:10.508538 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:16:10.518172 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:16:10.522447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:16:10.522567 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Creating image(s)
May 13 04:16:10.523227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:10.523425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:10.524015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:10.524184 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:10.697925 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Successfully created port: 26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:16:11.011900 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:16:11.026102 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:11.026504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:11.026919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:11.210723 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:11.210894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:11.211093 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attaching volume 99367786-ac0d-4955-a3d0-5375f71bc972 to /dev/vdb
May 13 04:16:11.282096 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:11.299530 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Successfully updated port: 26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:16:11.307770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:16:11.333948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:11.379943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-changed-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:11.381140 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Refreshing instance network info cache due to event network-changed-26daf7df-a690-40cc-bfc5-7a07ec641cda. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:16:11.382967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] Acquiring lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:11.384691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] Acquired lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:11.387681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:16:11.388492 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Refreshing network info cache for port 26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:16:11.390178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:16:11.406374 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:16:11.407781 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:feb1:31d9', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fea7:d95a'] 
May 13 04:16:11.407934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:16:11.409913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:16:11.410077 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:11.410299 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating existing volume attachment record: 795c70f5-90ab-4469-a36b-38a2a054f1c7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:16:11.806916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:11.889298 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:11.893035 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:11.893473 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:11.894532 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:11.985719 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:16:11.988238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.part --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:11.988637 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] 847ecd1e-483c-4243-aff4-8f8bcced6223 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:16:11.990497 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:16:11.990989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.part /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.010705 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:16:12.013346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:12.013346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:12.014502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:12.014942 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:16:12.036079 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:16:12.040864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:12.042500 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:16:12.045413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:12.048883 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:12.051578 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Creating image(s)
May 13 04:16:12.053129 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:12.054378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:12.055020 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:12.055650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:12.055860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:12.056185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:12.056550 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.056764 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:12.057726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:12.058364 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2f51e1d9-c12d-41f6-b52a-44d07df401ba req-8ba5fc64-e4d9-4cc3-b85e-892a5e979d4b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state active and task_state rescuing.
May 13 04:16:12.059643 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:12.061945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.061945 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.067188 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.070952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.085908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:12.085908 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:12.085908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:12.085908 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:12.099267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:16:12.099267 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:12.099267 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:12.099267 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:12.099267 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:12.099267 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:12.099267 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:12.099642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:12.100096 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0452(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:12.100555 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:12.102607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:16:12.102607 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:12.102607 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:12.102607 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:12.102607 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:12.102607 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:12.102607 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:12.107405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:12.107405 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0535(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:12.107405 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:12.107405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.part /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.converted" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.112179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.195539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.124s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.195994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:12.196649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:12.197206 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.201365 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.201702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.224881 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:12.233623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.235227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.208s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.236547 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.241265 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.243782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:12.244800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:12.246547 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.249059 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:12.249825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.316855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.317546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.345681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.349525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf,backing_fmt=raw /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.372202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk 1073741824" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.373162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.374097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.412203 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf,backing_fmt=raw /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.413581 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "ef5f7bebdf66015e8d39f5276ac246c6dd9d9fcf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.413581 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'migration_context' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:12.465951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.466448 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:16:12.466698 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:12.576297 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:12.576838 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Cannot resize image /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:16:12.577769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:16:12.577944 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Ensure instance console log exists: /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:16:12.578370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:12.578666 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:12.578845 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:12.584678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:12.729605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bfdb2623-05c0-462f-8fbd-e512e14d6889 req-a11f2043-5895-47fd-8059-f1dd88a74e96 service nova] Releasing lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:12.730125 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquired lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:12.733342 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:12.916873 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:12.917123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:16:12.917806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start _get_guest_xml network_info=[{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:87:4e:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '847ecd1e-483c-4243-aff4-8f8bcced6223', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '0f5d5e68-798e-4ec5-ade4-5146c9032019', 'attached_at': '', 'detached_at': '', 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'serial': '084b2bf2-b3ae-4a66-9d82-8793e064204d'}, 'disk_bus': 'virtio', 'attachment_id': 'fe581fd0-fd6f-49d2-997d-ba11df8bb28d', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:16:12.918030 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:13.100955 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:13.104945 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:13.123051 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:13.123051 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:13.126766 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:13.126766 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.141383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.152353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.165346 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.166039 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.177766 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.178207 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:13.229681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:16:13.229681 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:16:13.229681 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.240981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:16:13.240981 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:16:13.240981 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.247437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.254788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.270047 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.273396 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('17', '-', '-', 0) found on session 47 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:13.273396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:13.288331 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.246s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:13.288331 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:13.291833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('18', '-', '-', 0) found on session 48 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:13.291833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:13.301885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 47 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:13.304612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:13.314340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 48 and hctl ['18', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:13.380223 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:16:13.420833 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:13.433854 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:16:13.434787 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456', uuid='0f5d5e68-798e-4ec5-ade4-5146c9032019'), owner=OwnerMeta(userid='f077cae41c324b0bac3646dc90ca89a5', username='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member', projectid='6a9bc4b864dd4763813e225868b7d67c', projectname='tempest-ServerBootFromVolumeStableRescueTest-132730244'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:87:4e:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645773.434183) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:16:13.439607 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:16:13.439962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:16:13.448014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:16:13.448014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:16:13.449721 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:16:13.455070 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:16:13.455526 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:16:13.455755 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:16:13.455929 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:16:13.456229 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:16:13.456513 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:16:13.456773 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:16:13.457991 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:16:13.457991 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:16:13.458113 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:16:13.458260 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:16:13.458502 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:13.968362 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:14.002943 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0010496180000245658 future=<Future at 0x7a463c1544a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:14.003079 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:14.003283 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.901273321999952 future=<Future at 0x7a463c154440 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:14.003409 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.901124682000045 future=<Future at 0x7a463c154440 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:14.005713 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645759.001772, d25a6ded-e4d5-4fcd-83f8-e5529244bcd7 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:14.005875 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] VM Stopped (Lifecycle Event)
May 13 04:16:14.010108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:14.115385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:14.117416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:14.117416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:14.117416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:14.118107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:16:14.118912 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:14.119450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:14.132769 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:14.314306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 48 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:14.314306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:14.493658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:14.510983 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d25a6ded-e4d5-4fcd-83f8-e5529244bcd7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:14.534895 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Updating instance_info_cache with network_info: [{"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:14.616990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:14.701784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.040789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Releasing lock "refresh_cache-d22338d1-9a06-420b-bdec-026531fd3ba7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:15.041233 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance network_info: |[{"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:16:15.044267 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Start _get_guest_xml network_info=[{"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:16:15.047816 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:16:15.049829 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1397759640', uuid='d22338d1-9a06-420b-bdec-026531fd3ba7'), owner=OwnerMeta(userid='04922e90c12c49569c5ef4bd0c667e0c', username='tempest-VolumesActionsTest-863508426-project-member', projectid='d845c7c9f6c54bcd93149d01872b0a43', projectname='tempest-VolumesActionsTest-863508426'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645775.0493) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:16:15.052501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:16:15.053097 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:16:15.054277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:16:15.054508 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:16:15.055749 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:16:15.056392 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:16:15.056635 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:16:15.056635 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:16:15.056745 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:16:15.056989 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:16:15.056989 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:16:15.057173 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:16:15.058148 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:16:15.058148 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:16:15.058255 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:16:15.058403 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:16:15.067488 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Found WWN 330000000b896b8cb for multipath device dm-9 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:16:15.075420 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.061s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:15.076307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.957s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:15.078376 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== connect_volume: return (3063ms) {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-9', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:15.079013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:16:15.079545 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-9', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:16:15.085479 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1397759640',display_name='tempest-VolumesActionsTest-instance-1397759640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-1397759640',id=25,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-fa2y8rzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:11Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d22338d1-9a06-420b-bdec-026531fd3ba7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:16:15.085791 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:15.086453 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:15.088574 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'flavor' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:15.089942 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lazy-loading 'pci_devices' on Instance uuid d22338d1-9a06-420b-bdec-026531fd3ba7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:15.095776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:15.097408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:15.097408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:15.097408 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:15.097900 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:15.098680 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:15.112498 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:15.112498 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:15.125686 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:15.125686 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:15.128234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:15.139732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.154802 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.155372 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:15.155372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:15.155785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:15.156192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('16', '0', '0', 0) found on session 46 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:15.156334 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.166381 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:15.166737 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:15.167031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.070s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:15.167765 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:15.169195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 46 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:15.169640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:15.169937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] HCTL ('15', '0', '0', 0) found on session 45 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:15.170121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:15.181743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Searching for a device in session 45 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:15.181986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:15.594531 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <uuid>d22338d1-9a06-420b-bdec-026531fd3ba7</uuid>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <name>instance-00000019</name>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesActionsTest-instance-1397759640</nova:name>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:16:15</nova:creationTime>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:user uuid="04922e90c12c49569c5ef4bd0c667e0c">tempest-VolumesActionsTest-863508426-project-member</nova:user>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:project uuid="d845c7c9f6c54bcd93149d01872b0a43">tempest-VolumesActionsTest-863508426</nova:project>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         <nova:port uuid="26daf7df-a690-40cc-bfc5-7a07ec641cda">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <system>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="serial">d22338d1-9a06-420b-bdec-026531fd3ba7</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="uuid">d22338d1-9a06-420b-bdec-026531fd3ba7</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </system>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <os>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </os>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <features>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </features>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   <devices>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.config"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:5a:49:e7"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <target dev="tap26daf7df-a6"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </interface>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/console.log" append="off"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </serial>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <video>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </video>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </rng>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:   </devices>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]: </domain>
May 13 04:16:15.594531 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Preparing to wait for external event network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1397759640',display_name='tempest-VolumesActionsTest-instance-1397759640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-1397759640',id=25,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-fa2y8rzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:11Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d22338d1-9a06-420b-bdec-026531fd3ba7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:15.598259 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:16:15.598971 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attempting to attach volume 99367786-ac0d-4955-a3d0-5375f71bc972 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:16:15.599153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.599542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:15.599925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:16:15.600772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:   <alias name="ua-99367786-ac0d-4955-a3d0-5375f71bc972"/>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:   <serial>99367786-ac0d-4955-a3d0-5375f71bc972</serial>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:15.600772 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:16:15.604016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.604402 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c746007c-c9f2-52af-84a3-136954d79801', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:15.605219 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.605805 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:15.613093 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.617769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.619414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26daf7df-a6, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:15.619414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26daf7df-a6, col_values=(('qos', UUID('4eb222c7-ed1c-4123-93ba-be3ed040be7c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:15.619414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26daf7df-a6, col_values=(('external_ids', {'iface-id': '26daf7df-a690-40cc-bfc5-7a07ec641cda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:49:e7', 'vm-uuid': 'd22338d1-9a06-420b-bdec-026531fd3ba7'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:15.619414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.620703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:15.634038 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:15.640514 np0000000669 nova-compute[97951]: INFO os_vif [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6')
May 13 04:16:16.097357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:16:17.085492 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:17.086160 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:17.118116 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Found WWN 330000000cdfa9ca1 for multipath device dm-5 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:16:17.118297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:17.118516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== connect_volume: return (2998ms) {'type': 'block', 'scsi_wwn': '330000000cdfa9ca1', 'path': '/dev/dm-5', 'multipath_id': '330000000cdfa9ca1'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:17.118637 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cdfa9ca1', 'path': '/dev/dm-5', 'multipath_id': '330000000cdfa9ca1'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:16:17.166831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:17.166973 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:17.168143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] No VIF found with MAC fa:16:3e:5a:49:e7, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:17.168143 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Using config drive
May 13 04:16:17.304079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:17.304312 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:17.304493 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:17.304625 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No VIF found with MAC fa:16:3e:71:ea:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:17.625722 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643698456',id=24,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:04Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-vndc5wzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:05Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=0f5d5e68-798e-4ec5-ade4-5146c9032019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:87:4e:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:16:17.627431 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "vif_mac": "fa:16:3e:87:4e:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:17.627431 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:17.627687 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:17.675930 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:17.852634 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Creating config drive at /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.config
May 13 04:16:17.857232 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphkvv5ezz {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:17.908559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:17.908938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:17.926361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphkvv5ezz" returned: 0 in 0.069s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:18.084896 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:18.085418 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:18.130992 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:18.131828 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] End _get_guest_xml xml=<domain type="qemu">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <uuid>0f5d5e68-798e-4ec5-ade4-5146c9032019</uuid>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <name>instance-00000018</name>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1643698456</nova:name>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:16:13</nova:creationTime>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:user uuid="f077cae41c324b0bac3646dc90ca89a5">tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member</nova:user>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:project uuid="6a9bc4b864dd4763813e225868b7d67c">tempest-ServerBootFromVolumeStableRescueTest-132730244</nova:project>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         <nova:port uuid="e72020fc-4ee8-4b84-b1e9-ef35713d8f84">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <system>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="serial">0f5d5e68-798e-4ec5-ade4-5146c9032019</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="uuid">0f5d5e68-798e-4ec5-ade4-5146c9032019</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </system>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <os>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </os>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <features>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </features>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   <devices>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <alias name="ua-084b2bf2-b3ae-4a66-9d82-8793e064204d"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-5"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <serial>084b2bf2-b3ae-4a66-9d82-8793e064204d</serial>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <boot order="1"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:87:4e:1e"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <target dev="tape72020fc-4e"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </interface>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/console.log" append="off"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </serial>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <video>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </video>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </rng>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:   </devices>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]: </domain>
May 13 04:16:18.131828 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:16:18.142879 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance destroyed successfully.
May 13 04:16:18.412553 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:16:18.445866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.482635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.485879 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.603804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.818263 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.827675 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.829837 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.853075 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.859989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:18.888985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7db0bc98-89e0-4aa0-984a-a6d264436ddc tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.678s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:18.972433 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:18.972673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:18.976608 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:16:18.977103 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Claim successful on node np0000000669
May 13 04:16:19.079527 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:19.080299 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:19.459822 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645779.4592614, d22338d1-9a06-420b-bdec-026531fd3ba7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:19.459822 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] VM Started (Lifecycle Event)
May 13 04:16:19.496216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:19.671945 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:19.673736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:19.673736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:19.673736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] No VIF found with MAC fa:16:3e:87:4e:1e, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:19.674411 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Using config drive
May 13 04:16:19.962558 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:19.964312 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645779.9641085, d22338d1-9a06-420b-bdec-026531fd3ba7 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:19.964473 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] VM Paused (Lifecycle Event)
May 13 04:16:20.179269 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:20.328964 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Stashing vm_state: active {{(pid=97951) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 04:16:20.466803 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:20.468960 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:20.620047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:20.684585 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:20.684741 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'keypairs' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:20.849880 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:20.850200 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:20.902745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:20.971079 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:16:21.083733 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:21.084134 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:21.187443 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:21.190204 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:21.343787 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Creating config drive at /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config.rescue
May 13 04:16:21.346751 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpby3ifhw4 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:21.363820 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:21.400901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpby3ifhw4" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:21.878495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.906s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:21.879306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.976s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:21.879536 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:16:21.902030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:21.907917 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:21.934650 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:22.018231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:22.048542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:22.049334 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:22.084053 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:22.084401 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:22.084599 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:16:22.084983 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:22.385352 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:16:22.385812 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:16:22.386147 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:22.386440 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:22.398808 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:16:22.399037 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Claim successful on node np0000000669
May 13 04:16:22.492062 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-13579dcc-effa-4b81-9306-25bfd7f8b77c req-24e5e4cb-570e-4c9c-aaae-3f8269d6c649 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:22.493096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13579dcc-effa-4b81-9306-25bfd7f8b77c req-24e5e4cb-570e-4c9c-aaae-3f8269d6c649 service nova] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:22.494361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13579dcc-effa-4b81-9306-25bfd7f8b77c req-24e5e4cb-570e-4c9c-aaae-3f8269d6c649 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:22.494361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13579dcc-effa-4b81-9306-25bfd7f8b77c req-24e5e4cb-570e-4c9c-aaae-3f8269d6c649 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:22.494361 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-13579dcc-effa-4b81-9306-25bfd7f8b77c req-24e5e4cb-570e-4c9c-aaae-3f8269d6c649 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Processing event network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:16:22.498247 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:16:22.502263 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645782.5018585, d22338d1-9a06-420b-bdec-026531fd3ba7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:22.502263 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] VM Resumed (Lifecycle Event)
May 13 04:16:22.505090 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:16:22.517540 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b11065076cd40ffaa5099174eda4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c06d9163829483dafb7a6dcd1a3f194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:16:22.519733 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance spawned successfully.
May 13 04:16:22.520307 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:16:22.595009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:22.601206 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:22.909667 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:16:22.914994 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating resource usage from migration 11ed76e1-18c3-445a-b1a9-c38b6dd39d10
May 13 04:16:22.975844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-22657d2a-dc2c-4e06-b841-82711667db5c tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:23.008187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:23.012205 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:23.027148 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.027304 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.027633 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.027923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.028414 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.028414 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:23.195765 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Successfully created port: d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:16:23.416670 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:16:23.517199 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:16:23.517612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 0f5d5e68-798e-4ec5-ade4-5146c9032019 due to new event <LifecycleEvent: 1778645783.517281, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:16:23.519249 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645783.517281, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:23.519913 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Resumed (Lifecycle Event)
May 13 04:16:23.540155 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Took 11.50 seconds to spawn the instance on the hypervisor.
May 13 04:16:23.541186 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:23.862798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:23.863193 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:23.869879 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Successfully updated port: d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:16:23.979348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:23.979348 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:24.023015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:24.025534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:24.054275 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Took 17.55 seconds to build instance.
May 13 04:16:24.071960 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Unrescuing
May 13 04:16:24.072145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:24.072248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquired lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:24.072360 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:24.374367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:24.376612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquired lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:24.377048 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:24.379215 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:24.431353 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:16:24.434352 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:16:24.434352 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Creating image(s)
May 13 04:16:24.434352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.434352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.435101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.435868 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:24.440519 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:24.441808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:24.482997 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:24.499634 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:24.528367 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:16:24.528860 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645784.5285344, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:24.528992 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Started (Lifecycle Event)
May 13 04:16:24.553176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:24.554379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.554379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.554934 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:24.558832 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:16:24.559948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:24.563343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.071s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.579105 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:24.595666 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:24.596544 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.597107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.597107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.597364 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] No waiting events found dispatching network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:24.597621 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received unexpected event network-vif-plugged-26daf7df-a690-40cc-bfc5-7a07ec641cda for instance with vm_state active and task_state None.
May 13 04:16:24.597790 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:24.597975 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.598670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.600193 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.600521 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:24.600694 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:24.600829 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:24.600978 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.601139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.601263 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.601420 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:24.601563 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:24.601715 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-changed-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:24.601858 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Refreshing instance network info cache due to event network-changed-d1b390f0-51af-433c-94f1-c1c34298f804. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:16:24.602000 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Acquiring lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:24.654877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:24.658472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:24.704482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk 1073741824" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:24.705013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.708360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:24.801042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:24.804469 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:16:24.804469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:24.900437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Cannot resize image /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Ensure instance console log exists: /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:24.902742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.907182 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.002604879000045912 future=<Future at 0x7a463c154440 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:24.907353 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:24.976927 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:16:24.992088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.113s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:24.992576 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Migrating
May 13 04:16:24.992620 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:16:24.998062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.408s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:25.000005 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:25.000152 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:16:25.019793 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:25.035298 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:25.043172 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:25.209867 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [{"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:25.212301 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:25.367922 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating instance_info_cache with network_info: [{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:25.393197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.530s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:25.520496 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:25.520650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:25.520800 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:25.545981 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:16:25.623131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:25.715559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Releasing lock "refresh_cache-0f5d5e68-798e-4ec5-ade4-5146c9032019" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:25.716124 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'flavor' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:25.870504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Releasing lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:25.870504 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Instance network_info: |[{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:16:25.870917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Acquired lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:25.872753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Start _get_guest_xml network_info=[{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:16:25.873105 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Refreshing network info cache for port d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:16:25.878782 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:16:25.880103 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-2146979515', uuid='e23736e9-57ca-4381-be15-40188229ff0c'), owner=OwnerMeta(userid='6b11065076cd40ffaa5099174eda4db9', username='tempest-AttachVolumeNegativeTest-1451451802-project-member', projectid='4c06d9163829483dafb7a6dcd1a3f194', projectname='tempest-AttachVolumeNegativeTest-1451451802'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645785.8797011) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:16:25.885868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:16:25.886587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:16:25.889157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:16:25.893598 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:16:25.894509 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:16:25.895734 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:16:25.896430 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:16:25.896598 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:16:25.896965 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:16:25.897101 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:16:25.897225 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:16:25.898922 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:16:25.899240 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:16:25.899471 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:16:25.899639 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:16:25.899800 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:16:25.924350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2146979515',display_name='tempest-AttachVolumeNegativeTest-server-2146979515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-2146979515',id=26,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvx5Fy/RKL0dhhNSx39GBEWKc37BjypCq9JFE2i8+CfH+PZMQQD2d3qH0ypRykO+evaO6y0NxxybiYG4Q973001O3NwoWNPxbrSG2IjrLmwrJhVPyp//o64FooPn3Wmxw==',key_name='tempest-keypair-1395858231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-loa29dwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=e23736e9-57ca-4381-be15-40188229ff0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:16:25.924671 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:25.926073 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:25.927592 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'pci_devices' on Instance uuid e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:26.025860 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:26.086521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.193857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.194470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.259195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.265961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.288929 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.318060 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.322859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.377884 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:26.433766 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] End _get_guest_xml xml=<domain type="qemu">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <uuid>e23736e9-57ca-4381-be15-40188229ff0c</uuid>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <name>instance-0000001a</name>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2146979515</nova:name>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:16:25</nova:creationTime>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:user uuid="6b11065076cd40ffaa5099174eda4db9">tempest-AttachVolumeNegativeTest-1451451802-project-member</nova:user>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:project uuid="4c06d9163829483dafb7a6dcd1a3f194">tempest-AttachVolumeNegativeTest-1451451802</nova:project>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         <nova:port uuid="d1b390f0-51af-433c-94f1-c1c34298f804">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <system>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="serial">e23736e9-57ca-4381-be15-40188229ff0c</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="uuid">e23736e9-57ca-4381-be15-40188229ff0c</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </system>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <os>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </os>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <features>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </features>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   <devices>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.config"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:37:93:8a"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <target dev="tapd1b390f0-51"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </interface>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/console.log" append="off"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </serial>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <video>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </video>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </rng>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:   </devices>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]: </domain>
May 13 04:16:26.433766 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Preparing to wait for external event network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2146979515',display_name='tempest-AttachVolumeNegativeTest-server-2146979515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-2146979515',id=26,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvx5Fy/RKL0dhhNSx39GBEWKc37BjypCq9JFE2i8+CfH+PZMQQD2d3qH0ypRykO+evaO6y0NxxybiYG4Q973001O3NwoWNPxbrSG2IjrLmwrJhVPyp//o64FooPn3Wmxw==',key_name='tempest-keypair-1395858231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-loa29dwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=e23736e9-57ca-4381-be15-40188229ff0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:16:26.435589 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:26.437144 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:26.438250 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:16:26.442991 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.449563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:26.450987 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:16:26.451282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.451856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.477389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:26.477658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:26.480903 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attaching volume 9c419cf9-f309-4c47-aff7-90a621950c87 to /dev/vdb
May 13 04:16:26.487232 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.492902 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa5c0c6e-72dd-5553-95c5-3913dba17459', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:26.499210 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:26.503872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.508500 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.509231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1b390f0-51, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:26.509231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1b390f0-51, col_values=(('qos', UUID('eef948c8-b79e-4fcb-8960-f845dfd7559c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:26.509523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1b390f0-51, col_values=(('external_ids', {'iface-id': 'd1b390f0-51af-433c-94f1-c1c34298f804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:93:8a', 'vm-uuid': 'e23736e9-57ca-4381-be15-40188229ff0c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:26.511800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.511800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:26.524256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:26.525962 np0000000669 nova-compute[97951]: INFO os_vif [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51')
May 13 04:16:26.544309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.550476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.579908 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:26.605147 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999657627999795 future=<Future at 0x7a464859af60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:26.605147 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999283797999851 future=<Future at 0x7a464859af60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:26.605147 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999163708999959 future=<Future at 0x7a464859af60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:26.605147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:16:26.611958 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance destroyed successfully.
May 13 04:16:26.613281 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:26.629011 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:26.651155 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.669619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:26.670296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:26.671228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:26.671228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:26.671411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:26.685041 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Terminating instance
May 13 04:16:26.686597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.687204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.707460 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:16:26.717232 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:16:26.731152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:26.733764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:26.734146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:26.734472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:26.734712 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:26.738350 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b5c244ab-a65c-4d4d-8add-5885efdb76c0 req-f9550d9f-976d-4ce2-87f2-f2984005c5d4 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:26.738493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:16:26.742009 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:feb1:31d9', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fea7:d95a', 'fe80::fc16:3eff:fe5a:49e7', 'fe80::d86f:96ff:fe30:826'] 
May 13 04:16:26.742147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:16:26.742759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:16:26.743057 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:26.743341 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating existing volume attachment record: 5d221a51-8f84-4a2f-b8ff-55c8860a3839 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:16:26.786626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.788234 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:26.797890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:26.802500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:26.889421 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:26.896188 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:26.899596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:26.900170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.000764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.004160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:27.004412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.084079 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updated VIF entry in instance network info cache for port d1b390f0-51af-433c-94f1-c1c34298f804. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:16:27.084818 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating instance_info_cache with network_info: [{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:27.106235 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.107139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.124009 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Object Instance<0f5d5e68-798e-4ec5-ade4-5146c9032019> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:16:27.215419 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019/disk.rescue --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.218167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.238655 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:27.281811 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.287931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.315073 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.316248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.319966 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.322531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.348986 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:16:27.349858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:27.350140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:27.351622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:27.351622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:16:27.354472 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.371786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:27.372709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:27.373607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:27.374261 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:27.374578 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:27.374945 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:27.389919 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:27.389919 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:27.399763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:27.405902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:27.405902 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87] added
May 13 04:16:27.410241 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:27.410241 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:27.410241 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:27.426789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87] added
May 13 04:16:27.426789 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:27.426789 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:27.426789 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:27.426789 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:27.426789 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:27.426789 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:27.427001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:27.427977 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0527(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:27.427977 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:27.429889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.434784 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:27.439779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.548938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.549452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.588882 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d5448a38-f88f-4ed2-bc4b-b8cc6e42f5f7 req-95dab9c4-e32c-42df-9d19-13b6984a507c service nova] Releasing lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:27.632475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk.rescue --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.633147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.740822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.741603 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.790295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.842729 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.864108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.870620 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:27.922765 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999151876999804 future=<Future at 0x7a463c10c6e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:27.929458 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Instance destroyed successfully.
May 13 04:16:27.929983 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lazy-loading 'resources' on Instance uuid d22338d1-9a06-420b-bdec-026531fd3ba7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:27.935513 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.951781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.966620 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:27.992899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:27.993537 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.105613 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.111873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.127263 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:28.127491 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:28.127690 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:37:93:8a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:28.129854 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Using config drive
May 13 04:16:28.204334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.205020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.319977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.320395 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:28.323930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.410266 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:28.412774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.413490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.434808 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:28.447538 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:28.447538 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.457031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1397759640',display_name='tempest-VolumesActionsTest-instance-1397759640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-1397759640',id=25,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:23Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d845c7c9f6c54bcd93149d01872b0a43',ramdisk_id='',reservation_id='r-fa2y8rzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-863508426',owner_user_name='tempest-VolumesActionsTest-863508426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:24Z,user_data=None,user_id='04922e90c12c49569c5ef4bd0c667e0c',uuid=d22338d1-9a06-420b-bdec-026531fd3ba7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:28.458424 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converting VIF {"id": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "address": "fa:16:3e:5a:49:e7", "network": {"id": "3f8ca8ec-5b1e-452f-bd11-a63c97349906", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1820803432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d845c7c9f6c54bcd93149d01872b0a43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26daf7df-a6", "ovs_interfaceid": "26daf7df-a690-40cc-bfc5-7a07ec641cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:28.459102 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:28.459102 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.464182 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:28.464182 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:28.464728 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:28.467844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26daf7df-a6, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:28.467844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.473079 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:28.476484 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:28.477094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.478996 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:28.479179 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4eb222c7-ed1c-4123-93ba-be3ed040be7c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:28.480488 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:28.481422 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:28.490929 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:28.493861 np0000000669 nova-compute[97951]: INFO os_vif [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=26daf7df-a690-40cc-bfc5-7a07ec641cda,network=Network(3f8ca8ec-5b1e-452f-bd11-a63c97349906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26daf7df-a6')
May 13 04:16:28.494544 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Deleting instance files /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7_del
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.494833 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.495094 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:28.498581 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Deletion of /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7_del complete
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.511347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.511825 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:28.530526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.531590 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:28.538373 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000019, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/d22338d1-9a06-420b-bdec-026531fd3ba7/disk
May 13 04:16:28.542385 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:16:28.543418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.570768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.40.100,3260]
May 13 04:16:28.570768 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.40.100,3260] successful.
May 13 04:16:28.570768 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.583238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.50.100,3260]
May 13 04:16:28.583238 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.50.100,3260] successful.
May 13 04:16:28.583238 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.584080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.594776 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.595435 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=11017MB free_disk=74.12852096557617GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:16:28.595435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.596106 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.607290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.620163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:28.621246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.247s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:28.621246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:28.622414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('19', '-', '-', 0) found on session 49 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:28.622414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:28.635562 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:28.636122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:28.636122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:28.643270 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:28.651083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 49 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:28.651220 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:28.653054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('20', '-', '-', 0) found on session 50 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:28.653205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:28.678389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 50 and hctl ['20', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:28.811499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 0f5d5e68-798e-4ec5-ade4-5146c9032019 due to new event <LifecycleEvent: 1778645788.8110166, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:16:28.811650 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645788.8110166, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:28.811817 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Resumed (Lifecycle Event)
May 13 04:16:28.814913 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-777fe0aa-ca4f-4a3b-b1fb-1621c6df012f tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:28.826006 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Creating config drive at /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.config
May 13 04:16:28.842527 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] No waiting events found dispatching network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:28.846539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:28.847118 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:28.852365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Acquiring lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] No waiting events found dispatching network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-unplugged-26daf7df-a690-40cc-bfc5-7a07ec641cda for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:28.859020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.859930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.863107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:28.863816 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:28.864100 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:28.864385 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:28.864663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:28.864896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:28.865089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:28.865818 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:28.866207 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2c87c00a-5766-425a-b400-2d8518d0e25f req-e79e0d1a-a33e-4a4a-a4ce-4c5708bc6970 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received unexpected event network-vif-plugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with vm_state rescued and task_state unrescuing.
May 13 04:16:28.869015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyx5x13wy {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:28.939558 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyx5x13wy" returned: 0 in 0.070s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:28.964579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Starting migrate_disk_and_power_off {{(pid=97951) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 04:16:29.002661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.005416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.015705 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Took 1.78 seconds to destroy the instance on the hypervisor.
May 13 04:16:29.017690 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:29.018616 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:29.018616 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:29.019410 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:29.038713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.041871 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.078017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.130049 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:29.275592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:29.275592 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:29.275868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:29.276404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:29.276404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:29.276404 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-f5102f52-dba0-4faa-ab88-5c34fb2c9a64 req-2b918735-2b91-4cf3-ac59-077846cfd13e service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state active and task_state resize_migrating.
May 13 04:16:29.320595 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:29.324845 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:29.504548 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.530314 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance destroyed successfully.
May 13 04:16:29.531783 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:28Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:29.531981 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:29.532939 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:29.533280 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:29.537864 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.538183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccaadeda-1f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:29.539356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.540356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:29.549250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.550684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.551572 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0181112-258f-4550-b8e4-53498e3b155c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:29.551623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.552191 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:29.558384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.561567 np0000000669 nova-compute[97951]: INFO os_vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:16:29.562404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:29.562864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:29.563041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:29.624627 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Applying migration context for instance 9aea12d5-7e2c-4027-8bba-51aff967d2e0 as it has an incoming, in-progress migration 11ed76e1-18c3-445a-b1a9-c38b6dd39d10. Migration status is migrating {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 13 04:16:29.626418 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating resource usage from migration 11ed76e1-18c3-445a-b1a9-c38b6dd39d10
May 13 04:16:29.667937 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.676148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 50 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:29.677002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:29.700374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.714487 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 82e032bf-0b06-4188-9792-cc2de6b15ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 55d556b2-785a-44cd-b996-ff93c203bacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f780fcc0-01e6-461f-868d-1dddd9fbc1b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 0c26601c-8a4a-49fd-bb81-a146023d95fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2cf15625-daa9-41dd-b86a-1bddc18acfac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d2031784-5e1a-4659-9673-b16764bf8111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c527a60e-fb33-4b05-a851-91c95ebe0c8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 0f5d5e68-798e-4ec5-ade4-5146c9032019 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d22338d1-9a06-420b-bdec-026531fd3ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e23736e9-57ca-4381-be15-40188229ff0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Migration 11ed76e1-18c3-445a-b1a9-c38b6dd39d10 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 9aea12d5-7e2c-4027-8bba-51aff967d2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:16:29.717333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=3520MB phys_disk=95GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:16:28 up 30 min,  2 users,  load average: 9.81, 6.76, 3.33\n', 'num_instances': '14', 'num_vm_active': '11', 'num_task_None': '10', 'num_os_type_None': '14', 'num_proj_03c2202127ca4ec4a872d2af2f5e4576': '2', 'io_workload': '2', 'num_proj_5dd34c67006f4acc8b1a4ffc4bb599c1': '3', 'num_vm_rescued': '2', 'num_proj_6a9bc4b864dd4763813e225868b7d67c': '4', 'num_proj_94e441f4e3754f1692b7d4b86c603ca8': '1', 'num_task_resize_migrating': '1', 'num_proj_e7a830770c9b4796a5794a565f5f9336': '1', 'num_proj_32f6190e477e45ffb44a9f7754ab6965': '1', 'num_task_unrescuing': '1', 'num_task_deleting': '1', 'num_proj_d845c7c9f6c54bcd93149d01872b0a43': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_4c06d9163829483dafb7a6dcd1a3f194': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:16:29.811669 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:29.830364 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645789.8272054, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:29.830364 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Started (Lifecycle Event)
May 13 04:16:30.021900 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:30.027357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:30.050966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:30.159153 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:30.335517 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:30.348712 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:30.395074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found WWN 3300000007bb191d1 for multipath device dm-10 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:16:30.395391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:30.395571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000007bb191d1', 'path': '/dev/dm-10', 'multipath_id': '3300000007bb191d1'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:30.395684 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007bb191d1', 'path': '/dev/dm-10', 'multipath_id': '3300000007bb191d1'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:16:30.396082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.833s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:30.396499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:30.396679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:30.404569 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:30.441015 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:30.441790 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:30.441790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '48')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:30.445147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '47')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:30.445147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648282a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdl'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:30.445147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Removing multipathed devices sdl, sdm {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:30.445147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flush multipath device 330000000b896b8cb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:30.484701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:30.531848 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:30.577236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:30.577472 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:30.579026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:30.597360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:30.597360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:30.618798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.663280 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Took 1.64 seconds to deallocate network for instance.
May 13 04:16:30.673859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:16:30.673859 np0000000669 nova-compute[97951]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:16:30.673859 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.696649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:30.696934 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:30.710974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.725259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.783581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:16:30.783581 np0000000669 nova-compute[97951]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:16:30.783581 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.804154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:30.804348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:30.804478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== disconnect_volume: return (1241ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:30.804580 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:30.808492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:30.855958 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999433700000054 future=<Future at 0x7a463c7bc800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:30.856252 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645790.8560193, e23736e9-57ca-4381-be15-40188229ff0c => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:30.856462 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] VM Started (Lifecycle Event)
May 13 04:16:30.902090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:30.902693 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:30.922050 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attempting to attach volume 9c419cf9-f309-4c47-aff7-90a621950c87 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:16:30.928147 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:   <alias name="ua-9c419cf9-f309-4c47-aff7-90a621950c87"/>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:   <serial>9c419cf9-f309-4c47-aff7-90a621950c87</serial>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:30.928147 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:16:30.996344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:30.996344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:16:30.996344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:31.088931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:31.089336 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk.config /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:31.142478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk.config /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:31.142836 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk.info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:31.155516 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.156086 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.156671 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.156935 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.157161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.163415 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Terminating instance
May 13 04:16:31.172315 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.181079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "cp -r /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_resize/disk.info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" returned: 0 in 0.038s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:31.203527 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:31.359560 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:31.367874 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:31.368904 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645791.3679376, e23736e9-57ca-4381-be15-40188229ff0c => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:31.369108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.369237 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] VM Paused (Lifecycle Event)
May 13 04:16:31.370498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.371564 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.371722 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:31.371855 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state active and task_state resize_migrating.
May 13 04:16:31.372135 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Received event network-vif-deleted-26daf7df-a690-40cc-bfc5-7a07ec641cda {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:31.372268 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:31.372461 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.372584 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.372690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.372787 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Processing event network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:16:31.372917 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:31.373018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.373132 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.373220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.373335 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] No waiting events found dispatching network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:31.373463 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-12cf91e8-bbec-4d97-b5d8-c81c5c0a6a28 req-ccad868b-601a-4d34-8487-d11a41022459 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received unexpected event network-vif-plugged-d1b390f0-51af-433c-94f1-c1c34298f804 for instance with vm_state building and task_state spawning.
May 13 04:16:31.373864 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:16:31.379523 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:16:31.383136 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Instance spawned successfully.
May 13 04:16:31.383771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:16:31.667772 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:31.694777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:31.713201 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:16:31.713201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.117s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.713201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.541s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.714607 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:31.714834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:31.835413 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:31.841260 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:31.852847 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:31.853619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:31.854213 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:31.854465 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:31.854750 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:31.854936 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2482f617-793c-4ca8-b1de-0ee06f72329a req-eba936d8-2964-420a-a3cb-2cf117a41e56 service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:31.873742 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:31.882170 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645791.881775, e23736e9-57ca-4381-be15-40188229ff0c => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:31.882337 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] VM Resumed (Lifecycle Event)
May 13 04:16:31.899381 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:31.899381 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:31.899799 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:31.900021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:31.900272 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:31.901004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:16:32.029288 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Instance destroyed successfully.
May 13 04:16:32.029288 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid 0f5d5e68-798e-4ec5-ade4-5146c9032019 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:32.310301 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:32.310831 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:32.391132 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Port ccaadeda-1fb5-45f0-8390-231d698576c4 binding to destination host np0000000669 is already ACTIVE {{(pid=97951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 04:16:32.393461 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:32.397547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:32.411658 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Took 7.98 seconds to spawn the instance on the hypervisor.
May 13 04:16:32.411846 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:32.533461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643698456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643698456',id=24,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:22Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-vndc5wzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:29Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=0f5d5e68-798e-4ec5-ade4-5146c9032019,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:32.533725 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "address": "fa:16:3e:87:4e:1e", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72020fc-4e", "ovs_interfaceid": "e72020fc-4ee8-4b84-b1e9-ef35713d8f84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:32.534406 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:32.534695 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:32.539765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.539765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72020fc-4e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:32.540419 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.542596 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:32.543017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.544656 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.544947 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6114153-9440-4282-adfb-c4d29e6ba88e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:32.545621 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.547129 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:32.548107 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:32.552298 np0000000669 nova-compute[97951]: INFO os_vif [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72020fc-4e')
May 13 04:16:32.555434 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:32.557641 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:32.558054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:32.558386 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:32.560195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:32.560493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:32.560897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b2bf2-b3ae-4a66-9d82-8793e064204d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:32.561082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:32.600838 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:32.601227 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:32.601227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:32.601568 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '45')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:32.602394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d', '46')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:32.603291 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c0c8680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'): ({'sdk'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:32.603524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:32.603727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flush multipath device 330000000cdfa9ca1 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:32.620312 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:32.620544 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:32.620669 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:32.620798 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:d6:81:22, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:32.663266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:32.710167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:32.756966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:32.757152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:32.758864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:32.771932 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:32.772263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:32.784567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.819789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.40.100,3260]
May 13 04:16:32.819789 np0000000669 nova-compute[97951]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.40.100,3260] successful.
May 13 04:16:32.819789 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.840485 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.851067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.888773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.50.100,3260]
May 13 04:16:32.888773 np0000000669 nova-compute[97951]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-084b2bf2-b3ae-4a66-9d82-8793e064204d, portal: 192.168.50.100,3260] successful.
May 13 04:16:32.888773 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.900152 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e23736e9-57ca-4381-be15-40188229ff0c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:16:32.900545 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999757789999876 future=<Future at 0x7a46480969c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:32.912431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:32.912693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:32.912855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== disconnect_volume: return (354ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:32.913012 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:32.913316 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Deleting instance files /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019_del
May 13 04:16:32.913825 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Deletion of /opt/stack/data/nova/instances/0f5d5e68-798e-4ec5-ade4-5146c9032019_del complete
May 13 04:16:32.921649 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Took 14.00 seconds to build instance.
May 13 04:16:33.062568 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:33.401107 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:16:33.409992 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:33.410186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:33.410453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:33.423236 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.514s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:33.428806 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Took 1.76 seconds to destroy the instance on the hypervisor.
May 13 04:16:33.429458 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:33.429815 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:33.429988 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:33.430849 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:33.552310 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:33.571090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.858s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:33.640424 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Deleted allocations for instance d22338d1-9a06-420b-bdec-026531fd3ba7
May 13 04:16:33.910377 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dac5392a-de04-4383-9c08-0b8711f21e69 req-e6288ec3-dfbb-49db-9d9e-0aff6da51b7b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-deleted-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:33.910563 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-dac5392a-de04-4383-9c08-0b8711f21e69 req-e6288ec3-dfbb-49db-9d9e-0aff6da51b7b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Neutron deleted interface e72020fc-4ee8-4b84-b1e9-ef35713d8f84; detaching it from the instance and deleting it from the info cache
May 13 04:16:33.910747 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dac5392a-de04-4383-9c08-0b8711f21e69 req-e6288ec3-dfbb-49db-9d9e-0aff6da51b7b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:33.937589 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:33.940888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] Acquiring lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:33.941102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:33.941959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:33.941959 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] No waiting events found dispatching network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:33.942808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b4564080-1a40-448d-9f04-cfe717b7d9f6 req-e63a1627-945a-4fd0-9870-afc833164c9c service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Received event network-vif-unplugged-e72020fc-4ee8-4b84-b1e9-ef35713d8f84 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:34.186893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d44b4e75-e792-4eeb-a185-6b32fb43388d tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.709s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:34.264891 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-changed-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:34.265055 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Refreshing instance network info cache due to event network-changed-d1b390f0-51af-433c-94f1-c1c34298f804. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:16:34.265657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] Acquiring lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:34.265933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] Acquired lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:34.265933 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Refreshing network info cache for port d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:16:34.353161 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:34.422574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dac5392a-de04-4383-9c08-0b8711f21e69 req-e6288ec3-dfbb-49db-9d9e-0aff6da51b7b service nova] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Detach interface failed, port_id=e72020fc-4ee8-4b84-b1e9-ef35713d8f84, reason: Instance 0f5d5e68-798e-4ec5-ade4-5146c9032019 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:34.446506 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:34.522010 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:34.545891 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:34.545891 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:34.545891 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:34.650292 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71d098fa-5e8a-46e3-a7a1-e7fe8198dbcd tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Lock "d22338d1-9a06-420b-bdec-026531fd3ba7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.980s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:34.714025 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:16:34.714474 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.37 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:16:34.770287 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:34.856765 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Took 1.43 seconds to deallocate network for instance.
May 13 04:16:34.920351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:34.920626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:34.920815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:34.920942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:34.921101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:34.923179 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Terminating instance
May 13 04:16:35.050603 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:35.075282 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:35.265335 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updated VIF entry in instance network info cache for port d1b390f0-51af-433c-94f1-c1c34298f804. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:16:35.267253 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating instance_info_cache with network_info: [{"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:35.337563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:35.337747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:35.425777 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Took 0.57 seconds to detach 1 volumes for instance.
May 13 04:16:35.428653 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:35.429360 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Deleting volume: 084b2bf2-b3ae-4a66-9d82-8793e064204d {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:16:35.464514 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.490174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.495436 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:35.637945 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.647418 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.694936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:35.695062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:35.770857 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.770857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2e547375-4818-4e8b-9239-21e8c115f2f9 req-866152e5-92a4-40f5-b789-05fd534a82b5 service nova] Releasing lock "refresh_cache-e23736e9-57ca-4381-be15-40188229ff0c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:35.779598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:35.804895 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999675961000094 future=<Future at 0x7a463c107c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:35.805974 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Instance destroyed successfully.
May 13 04:16:35.806266 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'resources' on Instance uuid c527a60e-fb33-4b05-a851-91c95ebe0c8e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:35.841355 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:35.844789 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:36.009027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:36.009027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:36.197303 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Detaching volume 6d0f17cf-414a-45ca-8e2d-c4f6369634cd
May 13 04:16:36.241453 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Attempting to driver detach volume 6d0f17cf-414a-45ca-8e2d-c4f6369634cd from mountpoint /dev/vdb
May 13 04:16:36.249798 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Found disk vdb by alias ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:36.254637 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Found disk vdb by alias ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:36.254761 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Attempting to detach device vdb from instance 0c26601c-8a4a-49fd-bb81-a146023d95fb from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:16:36.255033 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <alias name="ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd"/>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <serial>6d0f17cf-414a-45ca-8e2d-c4f6369634cd</serial>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:36.255033 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:36.264065 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully detached device vdb from instance 0c26601c-8a4a-49fd-bb81-a146023d95fb from the persistent domain config.
May 13 04:16:36.264282 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] (1/8): Attempting to detach device vdb with device alias ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd from instance 0c26601c-8a4a-49fd-bb81-a146023d95fb from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:16:36.264522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <alias name="ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd"/>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <serial>6d0f17cf-414a-45ca-8e2d-c4f6369634cd</serial>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:36.264522 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:36.309286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2304711',display_name='tempest-ServerActionsTestOtherA-server-2304711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-2304711',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:58Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-td52k90a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=c527a60e-fb33-4b05-a851-91c95ebe0c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:36.309552 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "address": "fa:16:3e:a7:d9:5a", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bcbc4-b0", "ovs_interfaceid": "1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:36.309926 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:36.310105 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:36.311710 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:36.312040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7bcbc4-b0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:36.316609 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:36.322668 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:36.327769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:36.327769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcae3298-17ce-4aec-acb9-fb4a4775ae51) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:36.327769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:36.328096 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:36.330521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:36.332630 np0000000669 nova-compute[97951]: INFO os_vif [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bcbc4-b0')
May 13 04:16:36.337043 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:36.337509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:36.337698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:36.345006 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:36.345194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:36.345365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:36.345496 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:36.345609 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:36.345725 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:36.345834 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:36.345951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Acquiring lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:36.346066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:36.346192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:36.346289 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] No waiting events found dispatching network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:36.346430 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c671d5a7-f840-463a-8f4e-cacbfabfa176 req-69fa712c-2876-4bd3-aee2-4d41da29b253 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-unplugged-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:36.347066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:36.520469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:36.521009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:36.737654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:36.737861 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:36.792507 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645796.7918093, 0c26601c-8a4a-49fd-bb81-a146023d95fb => ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:16:36.792830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6d0f17cf-414a-45ca-8e2d-c4f6369634cd for instance 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:16:36.795503 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully detached device vdb from instance 0c26601c-8a4a-49fd-bb81-a146023d95fb from the live domain config.
May 13 04:16:36.796254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:36.796744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:36.797244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:36.867879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.530s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:36.870072 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:36.880622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:16:36.903345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:36.945406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:16:36.945718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:16:36.957672 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:16:36.957672 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:feb1:31d9', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd'] 
May 13 04:16:36.957672 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:16:36.957886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:16:36.958179 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:37.025499 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Detaching volume c42af889-1c22-4787-a8c8-40f034c5cdbe
May 13 04:16:37.091685 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Attempting to driver detach volume c42af889-1c22-4787-a8c8-40f034c5cdbe from mountpoint /dev/vdc
May 13 04:16:37.097814 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Found disk vdc by alias ua-c42af889-1c22-4787-a8c8-40f034c5cdbe {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:37.099854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Found disk vdc by alias ua-c42af889-1c22-4787-a8c8-40f034c5cdbe {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:37.099854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Attempting to detach device vdc from instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:16:37.100154 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <alias name="ua-c42af889-1c22-4787-a8c8-40f034c5cdbe"/>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <serial>c42af889-1c22-4787-a8c8-40f034c5cdbe</serial>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:37.100154 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:37.109593 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully detached device vdc from instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f from the persistent domain config.
May 13 04:16:37.109593 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] (1/8): Attempting to detach device vdc with device alias ua-c42af889-1c22-4787-a8c8-40f034c5cdbe from instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:16:37.109593 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <alias name="ua-c42af889-1c22-4787-a8c8-40f034c5cdbe"/>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <serial>c42af889-1c22-4787-a8c8-40f034c5cdbe</serial>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:37.109593 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:37.245569 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:37.584357 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645797.5838416, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => ua-c42af889-1c22-4787-a8c8-40f034c5cdbe> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:16:37.585358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-c42af889-1c22-4787-a8c8-40f034c5cdbe for instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:16:37.587636 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully detached device vdc from instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f from the live domain config.
May 13 04:16:37.588679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:37.589010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:37.589186 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:37.758074 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.749s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:37.802039 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Deleted allocations for instance 0f5d5e68-798e-4ec5-ade4-5146c9032019
May 13 04:16:37.942490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:37.942689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:37.942885 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attaching volume 9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 to /dev/vdc
May 13 04:16:37.985695 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:37.996463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:16:38.019391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:38.070404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:16:38.070742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:16:38.079508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:16:38.081288 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0d:eea2', 'fe80::4017:3bff:fee2:4398', 'fe80::d896:1ff:fef2:e127', 'fe80::fc16:3eff:fe6f:74b', 'fe80::683d:85ff:feda:a3a0', 'fe80::fc16:3eff:fe47:5202', 'fe80::fc16:3eff:fe8f:2e6c', 'fe80::fc16:3eff:fe90:a522', 'fe80::fc16:3eff:fe10:7697', 'fe80::fc16:3eff:fed6:8122', 'fe80::38e4:f2ff:fecf:d6d2', 'fe80::fc16:3eff:fe7b:abb5', 'fe80::fc16:3eff:feb1:31d9', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd'] 
May 13 04:16:38.081584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:16:38.081743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:16:38.082093 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:38.082401 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating existing volume attachment record: 6c5df9b0-bb29-4831-b6f7-fb985b004875 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:16:38.103638 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Starting finish_migration {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 04:16:38.105443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:16:38.105597 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Creating image(s)
May 13 04:16:38.106570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:38.189975 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:38.193706 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:16:38.194101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:38.288444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:38.289233 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Cannot resize image /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:16:38.635446 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:16:38.635781 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:38.635960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:38.793018 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:16:38.793337 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Ensure instance console log exists: /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:16:38.793849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:38.794132 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:38.794333 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:38.800168 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start _get_guest_xml network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '9aea12d5-7e2c-4027-8bba-51aff967d2e0', 'attached_at': '2026-05-13T04:16:37.000000', 'detached_at': '', 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'serial': '99367786-ac0d-4955-a3d0-5375f71bc972'}, 'disk_bus': 'virtio', 'attachment_id': '1ae95627-3d93-4574-bdc6-6e199321eda3', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:16:38.803985 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:16:38.805544 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2054040936', uuid='9aea12d5-7e2c-4027-8bba-51aff967d2e0'), owner=OwnerMeta(userid='bcc80bf8624b4787ad074f10f73872a8', username='tempest-ServerActionsTestOtherB-1906736706-project-member', projectid='e7a830770c9b4796a5794a565f5f9336', projectname='tempest-ServerActionsTestOtherB-1906736706'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645798.8051367) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:16:38.806504 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:16:38.806894 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:16:38.807623 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:16:38.807787 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:16:38.808764 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:16:38.811031 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:16:38.811199 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:16:38.811301 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:16:38.811468 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:16:38.811569 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:16:38.811670 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:16:38.811908 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:16:38.812011 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:16:38.812145 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:16:38.812259 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:16:38.812462 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:16:38.821819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a0faf29-ae70-4638-9655-34b3fd6aeec8 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "0f5d5e68-798e-4ec5-ade4-5146c9032019" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.666s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:38.824825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:16:38.913548 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:16:38.913996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:38.914285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:38.914879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:38.915369 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:16:38.915804 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:38.916587 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:39.139898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.802s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:39.140399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '606202ab-eaef-470a-af9d-f47457694f8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:39.140631 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.174207 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.174911 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:39.175260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '52')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:39.175392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '43')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.176858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b', '44')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.178643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c706ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:39.178966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:39.179310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Flush multipath device 330000000ddfccc09 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:39.244128 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:39.292937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:39.336005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:39.336339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:39.338139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:39.350789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:39.351131 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:39.364720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.408140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260]
May 13 04:16:39.408140 np0000000669 nova-compute[97951]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.40.100,3260] successful.
May 13 04:16:39.408140 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.431347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.446193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.492919 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260]
May 13 04:16:39.492919 np0000000669 nova-compute[97951]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-606202ab-eaef-470a-af9d-f47457694f8b, portal: 192.168.50.100,3260] successful.
May 13 04:16:39.492919 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.518249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.518705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:39.518977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] <== disconnect_volume: return (3181ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:39.519368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:39.520045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.722s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:39.520377 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:39.520580 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:39.520970 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Deleting instance files /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e_del
May 13 04:16:39.521591 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:39.524965 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Deletion of /opt/stack/data/nova/instances/c527a60e-fb33-4b05-a851-91c95ebe0c8e_del complete
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.558927 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.559436 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:39.559436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '52')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:39.559859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '39')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.561342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd', '40')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.562334 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c706ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'): ({'sdi'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:39.562779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:39.562977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Flush multipath device 33000000095bca3bf {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:39.600106 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:39.656364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:39.704695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:39.704695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:39.705375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:39.719360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:39.719420 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:39.732829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.775571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.40.100,3260]
May 13 04:16:39.775571 np0000000669 nova-compute[97951]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.40.100,3260] successful.
May 13 04:16:39.775571 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.802850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.814152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.851716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.50.100,3260]
May 13 04:16:39.851716 np0000000669 nova-compute[97951]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6d0f17cf-414a-45ca-8e2d-c4f6369634cd, portal: 192.168.50.100,3260] successful.
May 13 04:16:39.851716 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.870736 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:39.870977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:39.871125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] <== disconnect_volume: return (3073ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:39.871271 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:39.875578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.286s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:39.876083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42af889-1c22-4787-a8c8-40f034c5cdbe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:39.876312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.905981 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:39.906262 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:39.906596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '52')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:39.906596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '42')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.907447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe', '41')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:39.908283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b56c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'): ({'sdb'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:39.908444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:39.908663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flush multipath device 330000000f8713fb5 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:39.940017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:39.986466 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:40.032844 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Took 4.60 seconds to destroy the instance on the hypervisor.
May 13 04:16:40.034040 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:40.036637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:40.036637 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:40.036637 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:40.045951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:40.045951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:40.045951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:40.057297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:40.057732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:40.072098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.114432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.40.100,3260]
May 13 04:16:40.114432 np0000000669 nova-compute[97951]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.40.100,3260] successful.
May 13 04:16:40.114432 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.121943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:40.121943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:40.121943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:40.121943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:40.121943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:40.122959 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Terminating instance
May 13 04:16:40.132512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.138013 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:40.148545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.185347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.50.100,3260]
May 13 04:16:40.185347 np0000000669 nova-compute[97951]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-c42af889-1c22-4787-a8c8-40f034c5cdbe, portal: 192.168.50.100,3260] successful.
May 13 04:16:40.185347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.201065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.201303 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:40.202342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.566s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:40.202603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:16:40.205181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] <== disconnect_volume: return (2612ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:40.205181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:40.215239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:40.215839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:40.216377 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:40.216569 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:40.217037 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:40.217283 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:40.233766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:40.233766 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.235598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:40.235598 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96] added
May 13 04:16:40.246916 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:40.246916 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.246916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:40.247574 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:40.247574 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:40.251954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96] added
May 13 04:16:40.251954 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:40.251954 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:40.251954 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:40.251954 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:40.251954 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:40.251954 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:40.252393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:40.252393 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:40.252552 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:40.460702 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'flavor' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:40.625878 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:40.649433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:40.652494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:40.676902 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:40.695428 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-26f4bff1-718f-405d-8a19-ab964b2ef64e req-0b634c6e-71c7-460b-a3d6-c390ca915d80 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Received event network-vif-deleted-1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:40.695773 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-26f4bff1-718f-405d-8a19-ab964b2ef64e req-0b634c6e-71c7-460b-a3d6-c390ca915d80 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Neutron deleted interface 1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f; detaching it from the instance and deleting it from the info cache
May 13 04:16:40.696031 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-26f4bff1-718f-405d-8a19-ab964b2ef64e req-0b634c6e-71c7-460b-a3d6-c390ca915d80 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:40.785796 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'flavor' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:40.814234 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:40.822197 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:40.888266 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:40.888458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:40.888664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:40.889203 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:40.889498 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] No waiting events found dispatching network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:40.889704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e133562b-4419-4b04-b4b4-bf80895426ad req-e5aa2a09-905b-4978-af8f-4a12650fe3ae service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:41.013882 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998081641999988 future=<Future at 0x7a4648249580 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:41.018708 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Instance destroyed successfully.
May 13 04:16:41.022470 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid 2cf15625-daa9-41dd-b86a-1bddc18acfac {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:41.107144 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:41.200234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-26f4bff1-718f-405d-8a19-ab964b2ef64e req-0b634c6e-71c7-460b-a3d6-c390ca915d80 service nova] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Detach interface failed, port_id=1f7bcbc4-b075-4805-b3fe-e0e5cbf7247f, reason: Instance c527a60e-fb33-4b05-a851-91c95ebe0c8e could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:41.247988 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:41.253174 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:41.273099 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:41.273099 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:41.276171 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:41.276171 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.293771 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.302626 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.311860 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.312101 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.322856 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:41.327400 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:41.356176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.40.100,3260]
May 13 04:16:41.356176 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.40.100,3260] successful.
May 13 04:16:41.356176 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.373310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.383507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.50.100,3260]
May 13 04:16:41.383507 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.50.100,3260] successful.
May 13 04:16:41.383507 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.396396 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.396675 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:41.396905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:41.396905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:41.398215 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('7', '-', '-', 0) found on session 53 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:41.398215 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:41.398922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.428711 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:41.428981 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:41.429266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:41.429383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:41.437812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] HCTL ('8', '-', '-', 0) found on session 54 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:41.439543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:41.441959 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 53 and hctl ['7', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:41.460386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 54 and hctl ['8', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:41.475921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ea5c87fe-af32-434d-9cf1-5ecb55a915f4 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.781s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:41.526816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1266056070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1266056070',id=20,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:23Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-ujqix3fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:33Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=2cf15625-daa9-41dd-b86a-1bddc18acfac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:41.527114 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "address": "fa:16:3e:10:76:97", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9aaa1e-8e", "ovs_interfaceid": "fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:41.528300 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:41.528300 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:41.531351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:41.533765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9aaa1e-8e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:41.545401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:41.548530 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:41.552124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:41.552124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=982d60fa-77cd-4f9b-b375-5177f39d99bc) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:41.554267 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:41.554600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:41.558356 np0000000669 nova-compute[97951]: INFO os_vif [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:76:97,bridge_name='br-int',has_traffic_filtering=True,id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9aaa1e-8e')
May 13 04:16:41.559364 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Deleting instance files /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac_del
May 13 04:16:41.560308 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Deletion of /opt/stack/data/nova/instances/2cf15625-daa9-41dd-b86a-1bddc18acfac_del complete
May 13 04:16:41.605265 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0020045060000484227 future=<Future at 0x7a464859af60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:41.605406 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:41.606023 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.3162774190000164 future=<Future at 0x7a463c10c6e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:41.606023 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.316129429999819 future=<Future at 0x7a463c10c6e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:41.614285 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Took 1.58 seconds to deallocate network for instance.
May 13 04:16:41.798525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ad1feef3-f92f-4c04-8894-f7062130b3e0 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.277s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:42.079030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:42.079030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:42.079265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:42.079721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:42.079721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:42.084026 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Terminating instance
May 13 04:16:42.090360 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Took 1.46 seconds to destroy the instance on the hypervisor.
May 13 04:16:42.093400 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:42.093589 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:42.093918 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:42.093918 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:42.199971 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Took 0.58 seconds to detach 1 volumes for instance.
May 13 04:16:42.203137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Deleting volume: 606202ab-eaef-470a-af9d-f47457694f8b {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:16:42.239436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:42.240208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:42.240208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:42.240208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:42.240208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:42.243034 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Terminating instance
May 13 04:16:42.252955 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:42.442719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 53 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:42.442917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:42.461273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Searching for a device in session 54 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:42.461534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:42.602923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:42.635376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.638285 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.671378 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.682047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.707005 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.715553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.757314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:42.776553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:42.776822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:42.793946 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.823767 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.922739 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0008629989999917598 future=<Future at 0x7a463c10c6e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:42.923154 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:42.923154 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.9323397420000674 future=<Future at 0x7a463c7bc800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:42.923154 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.932209986000089 future=<Future at 0x7a463c7bc800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:42.924154 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Emitting event <LifecycleEvent: 1778645787.921737, d22338d1-9a06-420b-bdec-026531fd3ba7 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:42.926882 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] VM Stopped (Lifecycle Event)
May 13 04:16:42.974915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:42.985925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Acquiring lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] No waiting events found dispatching network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-unplugged-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:43.022482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Received event network-vif-deleted-fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:43.022744 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Neutron deleted interface fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6; detaching it from the instance and deleting it from the info cache
May 13 04:16:43.022744 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:43.125912 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999652769000022 future=<Future at 0x7a4648f0b890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:43.137070 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999549419999994 future=<Future at 0x7a463c7f5dc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:43.143301 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Instance destroyed successfully.
May 13 04:16:43.147750 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'resources' on Instance uuid dd0d182d-62d3-4878-8fcb-b987cdbb5e1f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:43.151197 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Instance destroyed successfully.
May 13 04:16:43.151197 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 0c26601c-8a4a-49fd-bb81-a146023d95fb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:43.220191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:16:43.226339 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:43.445977 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b03950b1-2db9-45f2-aff3-3b2dfd9329cd tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: d22338d1-9a06-420b-bdec-026531fd3ba7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:43.528172 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Detach interface failed, port_id=fe9aaa1e-8ebd-4dd5-9d23-d54798cd44c6, reason: Instance 2cf15625-daa9-41dd-b86a-1bddc18acfac could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:43.528340 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:43.529779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:43.529779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:43.529779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:43.529779 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:43.529779 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc3d1ca1-d41b-47f1-97f5-bc65ee20765f req-c1ca40a3-7d66-4f8e-ab99-0c6ed32088cf service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:43.651558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1405985100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-1405985100',id=15,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6aeW+RLlxa49ucWhbKppnAmwoxqn9Z/gX2f0477L4JdJYwt1atJsLgRbnVlEwNQfvocn20ezH3rl/geF6DY7T7YvKPadxOz6BFLZSLdHiHXKV2NKEpaIEgEWQb3LxR8A==',key_name='tempest-keypair-792508241',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:58Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-q34i8klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=dd0d182d-62d3-4878-8fcb-b987cdbb5e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:43.651792 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "address": "fa:16:3e:b1:31:d9", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fe4fce9-68", "ovs_interfaceid": "7fe4fce9-6847-4bd4-8178-cb1962e7a63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:43.652363 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:43.652606 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:43.653762 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.654123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fe4fce9-68, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:43.655927 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1627906994',display_name='tempest-ServerRescueNegativeTestJSON-server-1627906994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-1627906994',id=18,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVRUTeAg7oPBQCOjlnqXydXB6FT3Bmr7dDTvlUMK6eviUCFtlkJLOXzzjO3FfX25cL2CPSYCQWLcVB4OfGbjyRcU13rSSp/9YVL0rXVewsMMwGX5rziSdXWvxku9sstXA==',key_name='tempest-keypair-1383904969',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:49Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4nzcgc4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=0c26601c-8a4a-49fd-bb81-a146023d95fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:43.656142 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "1f41e74f-330f-4a30-a571-bb4455851fa5", "address": "fa:16:3e:7b:ab:b5", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f41e74f-33", "ovs_interfaceid": "1f41e74f-330f-4a30-a571-bb4455851fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:43.656848 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:43.657086 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:43.657344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.658966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:43.664741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.666060 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.666872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f41e74f-33, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:43.672375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.672375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:43.672877 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.674858 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.679264 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e767af-598f-4d44-aacd-9f2bc74b1b52) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:43.680007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.680584 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:43.683055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.683444 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.683601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8974ab0d-87fd-4d93-8a1e-528350d6d59e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:43.685025 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:43.686946 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:43.688457 np0000000669 nova-compute[97951]: INFO os_vif [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:31:d9,bridge_name='br-int',has_traffic_filtering=True,id=7fe4fce9-6847-4bd4-8178-cb1962e7a63d,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fe4fce9-68')
May 13 04:16:43.688457 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Deleting instance files /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f_del
May 13 04:16:43.690997 np0000000669 nova-compute[97951]: INFO os_vif [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:b5,bridge_name='br-int',has_traffic_filtering=True,id=1f41e74f-330f-4a30-a571-bb4455851fa5,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f41e74f-33')
May 13 04:16:43.692115 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Deleting instance files /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb_del
May 13 04:16:43.693240 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Deletion of /opt/stack/data/nova/instances/0c26601c-8a4a-49fd-bb81-a146023d95fb_del complete
May 13 04:16:43.703780 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Deletion of /opt/stack/data/nova/instances/dd0d182d-62d3-4878-8fcb-b987cdbb5e1f_del complete
May 13 04:16:43.730764 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Took 1.64 seconds to deallocate network for instance.
May 13 04:16:43.772669 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:43.772817 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:44.217121 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Took 1.46 seconds to destroy the instance on the hypervisor.
May 13 04:16:44.217121 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:44.217121 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:44.217121 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:44.217121 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:44.222346 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Took 1.62 seconds to destroy the instance on the hypervisor.
May 13 04:16:44.223941 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:44.225151 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:44.225276 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:44.225558 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:44.240202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:44.248916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found WWN 33000000029c3a3fa for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:16:44.248916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:44.248916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== connect_volume: return (5612ms) {'type': 'block', 'scsi_wwn': '33000000029c3a3fa', 'path': '/dev/dm-0', 'multipath_id': '33000000029c3a3fa'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:44.248916 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029c3a3fa', 'path': '/dev/dm-0', 'multipath_id': '33000000029c3a3fa'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:16:44.248916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.333s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:44.249218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:16:44.266844 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:44.273149 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:44.273149 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:44.273149 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:44.273466 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:44.273936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:44.274206 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:44.277386 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:44.301764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:44.301764 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:44.302953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:16:44.302953 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:16:44.320531 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:44.320531 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:44.320531 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0461(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:44.320972 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:44.324828 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:16:44.324828 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:16:44.324828 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:44.324828 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:44.324828 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:16:44.324828 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:16:44.324828 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:44.325091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:16:44.326016 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0526(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:16:44.326016 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:16:44.339157 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:44.358444 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:44.523574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:44.778084 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attempting to attach volume 9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:16:44.780608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:   <alias name="ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96"/>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:   <serial>9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96</serial>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:44.780608 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:16:44.790598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.013s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:44.793822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.554s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:44.907748 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Deleted allocations for instance c527a60e-fb33-4b05-a851-91c95ebe0c8e
May 13 04:16:45.018064 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c288e134-8120-447f-8fbc-b51dfd06cfba req-d59f6b30-ac73-4f61-adca-e3a1b5434e08 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-deleted-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:45.018276 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c288e134-8120-447f-8fbc-b51dfd06cfba req-d59f6b30-ac73-4f61-adca-e3a1b5434e08 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Neutron deleted interface 1f41e74f-330f-4a30-a571-bb4455851fa5; detaching it from the instance and deleting it from the info cache
May 13 04:16:45.018495 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c288e134-8120-447f-8fbc-b51dfd06cfba req-d59f6b30-ac73-4f61-adca-e3a1b5434e08 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:45.100950 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:45.101108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Acquiring lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:45.101249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:45.101391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:45.101513 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] No waiting events found dispatching network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:45.101754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-unplugged-7fe4fce9-6847-4bd4-8178-cb1962e7a63d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:45.101754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:45.101912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:45.102049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Acquiring lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] No waiting events found dispatching network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:45.103288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1ed2c20-9ae5-4d76-82fb-e9d21131b7e1 req-00a451ba-c3db-49fe-9024-1b0bd83a048c service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Received event network-vif-unplugged-1f41e74f-330f-4a30-a571-bb4455851fa5 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:45.322760 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:16:45.330349 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:45.344921 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:45.344921 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:16:45.349309 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:16:45.349309 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.360748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.370976 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.385670 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.386973 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.395819 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.396128 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:45.437188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:16:45.437188 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:16:45.437188 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.451190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:16:45.451190 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:16:45.451190 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.457018 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:45.460209 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.469192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.488034 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.488687 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:45.488975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:45.489045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:45.490955 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('11', '-', '-', 0) found on session 55 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:45.491248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:45.500429 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('12', '-', '-', 0) found on session 56 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:16:45.500429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:16:45.523553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 55 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:45.523553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:45.523553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 56 and hctl ['12', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:45.531780 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c288e134-8120-447f-8fbc-b51dfd06cfba req-d59f6b30-ac73-4f61-adca-e3a1b5434e08 service nova] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Detach interface failed, port_id=1f41e74f-330f-4a30-a571-bb4455851fa5, reason: Instance 0c26601c-8a4a-49fd-bb81-a146023d95fb could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:45.553688 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:45.729906 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:45.731623 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:45.856883 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0014974969999457244 future=<Future at 0x7a463c7bc800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:45.858080 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Emitting event <LifecycleEvent: 1778645790.8552501, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:45.858247 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:45.859050 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Stopped (Lifecycle Event)
May 13 04:16:45.860147 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.0401784489999955 future=<Future at 0x7a46480969c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:45.860351 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.0399641090000387 future=<Future at 0x7a46480969c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:45.936559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fad83f88-2eb8-4c58-ad39-84020f34122a tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "c527a60e-fb33-4b05-a851-91c95ebe0c8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.015s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:45.958385 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Took 1.74 seconds to deallocate network for instance.
May 13 04:16:46.058265 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Took 1.83 seconds to deallocate network for instance.
May 13 04:16:46.234569 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:46.363473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:46.365441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:46.473804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:46.490570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:46.490570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:46.490570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:46.490570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:46.490570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] No VIF found with MAC fa:16:3e:d6:81:22, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:46.523604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 56 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:16:46.523804 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:16:46.569854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:46.748514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.955s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:46.751354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.276s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:46.861766 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Deleted allocations for instance 2cf15625-daa9-41dd-b86a-1bddc18acfac
May 13 04:16:46.873522 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 04:16:47.228115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-524c51b1-7336-4c28-a9e8-1ccfec188fa6 req-0268b539-a3cd-4c45-b6db-fdb84aba713a service nova] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Received event network-vif-deleted-7fe4fce9-6847-4bd4-8178-cb1962e7a63d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:47.295491 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Found WWN 330000000b896b8cb for multipath device dm-2 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:16:47.300215 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:47.303448 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== connect_volume: return (8384ms) {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-2', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:47.303448 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-2', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:16:47.377904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:47.378533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:47.378533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:47.378645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:47.379296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:47.392031 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Terminating instance
May 13 04:16:47.574587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:47.574842 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:47.813167 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:28Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:16:47.813484 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:47.814349 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:47.817420 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] End _get_guest_xml xml=<domain type="qemu">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <uuid>9aea12d5-7e2c-4027-8bba-51aff967d2e0</uuid>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <name>instance-00000015</name>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <memory>262144</memory>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherB-server-2054040936</nova:name>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:16:38</nova:creationTime>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.micro" id="84">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:memory>256</nova:memory>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:user uuid="bcc80bf8624b4787ad074f10f73872a8">tempest-ServerActionsTestOtherB-1906736706-project-member</nova:user>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:project uuid="e7a830770c9b4796a5794a565f5f9336">tempest-ServerActionsTestOtherB-1906736706</nova:project>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         <nova:port uuid="ccaadeda-1fb5-45f0-8390-231d698576c4">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <system>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="serial">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="uuid">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </system>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <os>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </os>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <features>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </features>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   <devices>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <alias name="ua-99367786-ac0d-4955-a3d0-5375f71bc972"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-2"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <serial>99367786-ac0d-4955-a3d0-5375f71bc972</serial>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </disk>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:71:ea:9d"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <target dev="tapccaadeda-1f"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </interface>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/console.log" append="off"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </serial>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <video>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </video>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </rng>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:   </devices>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]: </domain>
May 13 04:16:47.817420 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:28Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-35194995-network", "vif_mac": "fa:16:3e:71:ea:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.821833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03dbe99b-d0d7-5329-9e5e-d8a22af5c471', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:47.824256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.825316 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.829095 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.829420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccaadeda-1f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:47.830523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccaadeda-1f, col_values=(('qos', UUID('e59627e1-d74f-46f9-b111-4c8e3fd58dc0')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:47.830523 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccaadeda-1f, col_values=(('external_ids', {'iface-id': 'ccaadeda-1fb5-45f0-8390-231d698576c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ea:9d', 'vm-uuid': '9aea12d5-7e2c-4027-8bba-51aff967d2e0'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:47.833054 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.835538 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:47.843883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.846335 np0000000669 nova-compute[97951]: INFO os_vif [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:16:47.888527 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-96a9a4e8-1ba2-4908-9041-c21877b0c68e tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "2cf15625-daa9-41dd-b86a-1bddc18acfac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.768s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:47.900823 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004544939999959752 future=<Future at 0x7a46480969c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:47.901885 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Emitting event <LifecycleEvent: 1778645792.900228, 0f5d5e68-798e-4ec5-ade4-5146c9032019 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:47.902178 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:47.903098 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] VM Stopped (Lifecycle Event)
May 13 04:16:47.904685 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.9003339079999932 future=<Future at 0x7a463c107c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:47.904685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:47.907439 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.8975479840000844 future=<Future at 0x7a463c107c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:47.939998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.966186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:47.977686 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.013787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.078878 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:48.094451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7f51587a-3126-49d5-8833-0fefa7054805 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:48.250456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.268229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.276709 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999651456000038 future=<Future at 0x7a464858a5d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:48.281788 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Instance destroyed successfully.
May 13 04:16:48.283657 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lazy-loading 'resources' on Instance uuid 8d2f3521-15f2-4140-9561-7798bbe03f60 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:48.407284 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: 0f5d5e68-798e-4ec5-ade4-5146c9032019] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:48.595242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.845s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:48.596469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.027s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:48.688391 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Deleted allocations for instance 0c26601c-8a4a-49fd-bb81-a146023d95fb
May 13 04:16:48.786243 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615490902',display_name='tempest-ServerActionsTestOtherA-server-615490902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestothera-server-615490902',id=2,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6Dzd+hoRKt5rnGxWibLHSAJKsclHwnGz+IChREf40bWXLpectgsJdWzk2RPcnRPA9YlkDH4cc0rh/5lqnQqzqy9veYVzZZRW2ouP39aMuMKOL8UrxaV1aKBVqvCuChQ==',key_name='tempest-keypair-297376737',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:12:06Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03c2202127ca4ec4a872d2af2f5e4576',ramdisk_id='',reservation_id='r-vwpz1ve9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1572513959',owner_user_name='tempest-ServerActionsTestOtherA-1572513959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cffc8fad0694442ad05ced625bbe1ad',uuid=8d2f3521-15f2-4140-9561-7798bbe03f60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:48.786243 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converting VIF {"id": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "address": "fa:16:3e:0d:ee:a2", "network": {"id": "3baf26bb-dd26-4524-9bca-fc0acbc82e26", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1075683288-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03c2202127ca4ec4a872d2af2f5e4576", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap455a1a1b-3a", "ovs_interfaceid": "455a1a1b-3a1c-4b13-b24d-e88a7707574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:48.787999 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:48.787999 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:48.789856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.790151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap455a1a1b-3a, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:48.792274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.793214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:48.802072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.805720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.805986 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7efe80ff-782a-488a-8b4c-c2a0acec6dc9) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:48.806713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.807195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:48.815150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:48.819868 np0000000669 nova-compute[97951]: INFO os_vif [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ee:a2,bridge_name='br-int',has_traffic_filtering=True,id=455a1a1b-3a1c-4b13-b24d-e88a7707574f,network=Network(3baf26bb-dd26-4524-9bca-fc0acbc82e26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap455a1a1b-3a')
May 13 04:16:48.820396 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Deleting instance files /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60_del
May 13 04:16:48.820879 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Deletion of /opt/stack/data/nova/instances/8d2f3521-15f2-4140-9561-7798bbe03f60_del complete
May 13 04:16:49.139919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:49.139919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:49.140163 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:49.140246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:49.140309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:49.146433 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Terminating instance
May 13 04:16:49.297144 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:49.297482 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:49.309185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] No waiting events found dispatching network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Acquiring lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] No waiting events found dispatching network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:49.311687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ccdbf46-b73b-4db5-95e1-c5a482a27381 req-5719d9ee-e7ea-4b08-bdea-0c49284f44f1 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-unplugged-455a1a1b-3a1c-4b13-b24d-e88a7707574f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:49.331090 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Took 1.43 seconds to destroy the instance on the hypervisor.
May 13 04:16:49.331528 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:49.331802 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:49.331949 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:49.332138 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:49.370456 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:49.370620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:49.370620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:16:49.370731 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] No VIF found with MAC fa:16:3e:71:ea:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:16:49.371835 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Using config drive
May 13 04:16:49.420284 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:49.485651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:49.485651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:49.538936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.652738 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:49.701749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.702192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cfadf314-1efd-44a1-878f-60b955efc7c7 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "0c26601c-8a4a-49fd-bb81-a146023d95fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.462s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:49.710684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.730059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.801777 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:49.889774 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.915311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.934005 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.974288 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:49.990234 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Detaching volume 9c419cf9-f309-4c47-aff7-90a621950c87
May 13 04:16:50.016166 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eebc55a8-bff5-4fe7-9339-917b6bc523b1 req-b664ff89-2410-4c7f-b720-c7fd80df1478 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Received event network-vif-deleted-455a1a1b-3a1c-4b13-b24d-e88a7707574f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:50.017379 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-eebc55a8-bff5-4fe7-9339-917b6bc523b1 req-b664ff89-2410-4c7f-b720-c7fd80df1478 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Neutron deleted interface 455a1a1b-3a1c-4b13-b24d-e88a7707574f; detaching it from the instance and deleting it from the info cache
May 13 04:16:50.017575 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eebc55a8-bff5-4fe7-9339-917b6bc523b1 req-b664ff89-2410-4c7f-b720-c7fd80df1478 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:50.079653 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attempting to driver detach volume 9c419cf9-f309-4c47-aff7-90a621950c87 from mountpoint /dev/vdb
May 13 04:16:50.089608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdb by alias ua-9c419cf9-f309-4c47-aff7-90a621950c87 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:50.092899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdb by alias ua-9c419cf9-f309-4c47-aff7-90a621950c87 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:50.092899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Attempting to detach device vdb from instance d2031784-5e1a-4659-9673-b16764bf8111 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:16:50.092899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <alias name="ua-9c419cf9-f309-4c47-aff7-90a621950c87"/>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <serial>9c419cf9-f309-4c47-aff7-90a621950c87</serial>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:50.092899 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:50.103103 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdb from instance d2031784-5e1a-4659-9673-b16764bf8111 from the persistent domain config.
May 13 04:16:50.103357 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] (1/8): Attempting to detach device vdb with device alias ua-9c419cf9-f309-4c47-aff7-90a621950c87 from instance d2031784-5e1a-4659-9673-b16764bf8111 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:16:50.104415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <alias name="ua-9c419cf9-f309-4c47-aff7-90a621950c87"/>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <serial>9c419cf9-f309-4c47-aff7-90a621950c87</serial>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:50.104415 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:50.188783 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.231818 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999669548999918 future=<Future at 0x7a464827fb90 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:50.240373 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Instance destroyed successfully.
May 13 04:16:50.241959 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid f780fcc0-01e6-461f-868d-1dddd9fbc1b4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:50.322642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.724s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:50.415337 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:50.448141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.459521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.467369 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.469705 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Deleted allocations for instance dd0d182d-62d3-4878-8fcb-b987cdbb5e1f
May 13 04:16:50.491717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.501089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.531302 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eebc55a8-bff5-4fe7-9339-917b6bc523b1 req-b664ff89-2410-4c7f-b720-c7fd80df1478 service nova] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Detach interface failed, port_id=455a1a1b-3a1c-4b13-b24d-e88a7707574f, reason: Instance 8d2f3521-15f2-4140-9561-7798bbe03f60 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:50.747014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1148087156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1148087156',id=16,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-7lnb0o68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:07Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=f780fcc0-01e6-461f-868d-1dddd9fbc1b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:50.747435 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "address": "fa:16:3e:90:a5:22", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2d911e-b5", "ovs_interfaceid": "1e2d911e-b54e-409e-a93c-5cc61bf9915f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:50.747820 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:50.748020 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:50.751479 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.751771 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e2d911e-b5, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:50.753220 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.755000 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:50.755722 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.758013 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.758243 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7c09e89-412d-4579-88f2-fba46db9b31b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:50.758837 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.759611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:50.760643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:50.763541 np0000000669 nova-compute[97951]: INFO os_vif [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:a5:22,bridge_name='br-int',has_traffic_filtering=True,id=1e2d911e-b54e-409e-a93c-5cc61bf9915f,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2d911e-b5')
May 13 04:16:50.769051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:50.769341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:50.769481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:50.771740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:50.771740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:50.771740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:50.796817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645810.7965057, d2031784-5e1a-4659-9673-b16764bf8111 => ua-9c419cf9-f309-4c47-aff7-90a621950c87> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:16:50.799076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9c419cf9-f309-4c47-aff7-90a621950c87 for instance d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:16:50.804963 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004015380000055302 future=<Future at 0x7a463c107c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:50.805810 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Emitting event <LifecycleEvent: 1778645795.8044493, c527a60e-fb33-4b05-a851-91c95ebe0c8e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:50.805810 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:50.806597 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] VM Stopped (Lifecycle Event)
May 13 04:16:50.809932 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.202266355999882 future=<Future at 0x7a4648249580 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:50.810156 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.201759805999927 future=<Future at 0x7a4648249580 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:50.812809 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdb from instance d2031784-5e1a-4659-9673-b16764bf8111 from the live domain config.
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:50.815693 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:50.816196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '56')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:50.816196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '35')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:50.818093 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:50.818093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:50.818093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:50.818379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d', '36')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:50.819361 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648230680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:50.820142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Removing multipathed devices sde, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:50.820142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Flush multipath device 33000000053f91692 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:50.859733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:50.913467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:50.920309 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Took 1.59 seconds to deallocate network for instance.
May 13 04:16:50.967566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:50.968018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:50.969447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:50.988435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:50.988435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:51.009039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.057632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.40.100,3260]
May 13 04:16:51.057632 np0000000669 nova-compute[97951]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.40.100,3260] successful.
May 13 04:16:51.057632 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.083561 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.097407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.149007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.50.100,3260]
May 13 04:16:51.149007 np0000000669 nova-compute[97951]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-0c9695ea-3162-4bb1-9e88-6f01e293ac6d, portal: 192.168.50.100,3260] successful.
May 13 04:16:51.149007 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.183728 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.183888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:51.183888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] <== disconnect_volume: return (414ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:51.184046 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:51.184932 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.368s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:51.185293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c419cf9-f309-4c47-aff7-90a621950c87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:51.186569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:51.189021 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Deleting instance files /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4_del
May 13 04:16:51.190084 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Deletion of /opt/stack/data/nova/instances/f780fcc0-01e6-461f-868d-1dddd9fbc1b4_del complete
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:51.226181 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:51.226542 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:51.226542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '56')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:51.226791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '49')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:51.227737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87', '50')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:51.228669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464810e0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'): ({'sdo'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:51.228868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Removing multipathed devices sdn, sdo {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:51.229176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flush multipath device 3300000007bb191d1 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:51.278232 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:51.312717 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: c527a60e-fb33-4b05-a851-91c95ebe0c8e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:51.319366 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645811.3189235, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:51.319527 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Resumed (Lifecycle Event)
May 13 04:16:51.321117 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:16:51.328345 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance running successfully.
May 13 04:16:51.329313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Failed to set time: agent not configured {{(pid=97951) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 04:16:51.329499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3bea6a0a-d4ae-4ec9-8705-5ecfd43f12f6 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] finish_migration finished successfully. {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 04:16:51.337285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:51.386092 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:51.388315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:51.389179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:51.401462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:51.401748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:51.419931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.436609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:51.436813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:51.464768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.40.100,3260]
May 13 04:16:51.464768 np0000000669 nova-compute[97951]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.40.100,3260] successful.
May 13 04:16:51.464768 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.487710 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0516e0bc-0f22-4cac-96b4-4ec46c32b1d2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "dd0d182d-62d3-4878-8fcb-b987cdbb5e1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.407s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:51.493620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.519124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.575399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.50.100,3260]
May 13 04:16:51.575399 np0000000669 nova-compute[97951]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-9c419cf9-f309-4c47-aff7-90a621950c87, portal: 192.168.50.100,3260] successful.
May 13 04:16:51.575399 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.597429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:51.597676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:51.597800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== disconnect_volume: return (781ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:51.598227 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:51.698144 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Took 2.04 seconds to destroy the instance on the hypervisor.
May 13 04:16:51.698921 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:51.699355 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:51.699427 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:51.700202 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:51.804987 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:51.825619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:51.832202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:52.102634 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:52.102874 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:52.116176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:52.120071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:52.120393 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:52.120458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:52.120648 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:52.120788 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:52.120885 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:52.121015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Acquiring lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:52.121130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:52.121226 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:52.121435 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] No waiting events found dispatching network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:52.121582 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-unplugged-1e2d911e-b54e-409e-a93c-5cc61bf9915f for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:52.121709 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:52.121908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:52.121997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:52.122119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:52.122175 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:52.122255 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state resized and task_state None.
May 13 04:16:52.122771 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:52.122862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:52.122976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:52.123066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:52.123161 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:52.123287 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-066bdfb8-3335-4ea5-900f-215f90b8e9c0 req-262ee3d5-c476-414d-9da3-25711d08bede service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state resized and task_state None.
May 13 04:16:52.140697 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6c595069-4ef0-40b4-8840-e802fb58460a req-7218fb7f-542a-4f9d-81b1-0b3a90b200e3 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Received event network-vif-deleted-1e2d911e-b54e-409e-a93c-5cc61bf9915f {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:52.141155 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-6c595069-4ef0-40b4-8840-e802fb58460a req-7218fb7f-542a-4f9d-81b1-0b3a90b200e3 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Neutron deleted interface 1e2d911e-b54e-409e-a93c-5cc61bf9915f; detaching it from the instance and deleting it from the info cache
May 13 04:16:52.141432 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-6c595069-4ef0-40b4-8840-e802fb58460a req-7218fb7f-542a-4f9d-81b1-0b3a90b200e3 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:52.181162 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:52.337105 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 04:16:52.337371 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645812.337167, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:52.337786 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Started (Lifecycle Event)
May 13 04:16:52.583627 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:52.605530 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:52.646743 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6c595069-4ef0-40b4-8840-e802fb58460a req-7218fb7f-542a-4f9d-81b1-0b3a90b200e3 service nova] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Detach interface failed, port_id=1e2d911e-b54e-409e-a93c-5cc61bf9915f, reason: Instance f780fcc0-01e6-461f-868d-1dddd9fbc1b4 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:16:52.842223 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:52.845884 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:16:52.893881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:53.085511 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Took 1.39 seconds to deallocate network for instance.
May 13 04:16:53.113196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.676s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:53.169901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:53.170149 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:53.170506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:53.170506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:53.170762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:53.175919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Terminating instance
May 13 04:16:53.190500 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Deleted allocations for instance 8d2f3521-15f2-4140-9561-7798bbe03f60
May 13 04:16:53.195072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ef7ebd77-3954-4220-8edc-8af881600223 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.711s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:53.198862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.305s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:53.539751 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:53.647340 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:16:53.647340 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Deleting volume: 0c9695ea-3162-4bb1-9e88-6f01e293ac6d {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:16:53.655936 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:53.656247 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:53.656577 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:53.682959 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:53.701926 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Detaching volume 9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96
May 13 04:16:53.719923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:53.737970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:53.768416 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Attempting to driver detach volume 9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 from mountpoint /dev/vdc
May 13 04:16:53.779976 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdc by alias ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:53.784775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Found disk vdc by alias ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:16:53.784907 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Attempting to detach device vdc from instance d2031784-5e1a-4659-9673-b16764bf8111 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:16:53.785210 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <alias name="ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96"/>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <serial>9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96</serial>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:53.785210 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:53.794566 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdc from instance d2031784-5e1a-4659-9673-b16764bf8111 from the persistent domain config.
May 13 04:16:53.794736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] (1/8): Attempting to detach device vdc with device alias ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 from instance d2031784-5e1a-4659-9673-b16764bf8111 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:16:53.794891 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <alias name="ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96"/>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <serial>9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96</serial>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]: </disk>
May 13 04:16:53.794891 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:16:53.858912 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Port ccaadeda-1fb5-45f0-8390-231d698576c4 binding to destination host np0000000669 is already ACTIVE {{(pid=97951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 04:16:53.859143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:16:53.859408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:16:53.859678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:53.863830 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:16:53.867363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.018912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.045182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.061914 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99962765400005 future=<Future at 0x7a464809d220 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:54.064742 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Instance destroyed successfully.
May 13 04:16:54.064742 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 55d556b2-785a-44cd-b996-ff93c203bacc {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:54.171502 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.175181 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.194066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:54.194225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:54.200968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a9ca2067-0807-454e-bbb8-3e0f88ab1684 tempest-ServerActionsTestOtherA-1572513959 tempest-ServerActionsTestOtherA-1572513959-project-member] Lock "8d2f3521-15f2-4140-9561-7798bbe03f60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.823s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:54.220140 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:54.222922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:54.223148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:54.223341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:54.223520 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:54.223662 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:54.223794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:54.223960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Acquiring lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:54.224116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:54.224257 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] Lock "55d556b2-785a-44cd-b996-ff93c203bacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:54.224423 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] No waiting events found dispatching network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:54.226028 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6410b963-b5aa-49a7-8b14-bd751bbf864f req-e1bf4410-7cc6-46af-8789-27b62242fa78 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-unplugged-8e41bccc-9580-4bc4-b021-122855ecc2a9 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:54.318120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.324021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.340896 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645814.3405914, d2031784-5e1a-4659-9673-b16764bf8111 => ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:16:54.342565 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 for instance d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:16:54.347461 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully detached device vdc from instance d2031784-5e1a-4659-9673-b16764bf8111 from the live domain config.
May 13 04:16:54.348242 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:54.348589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:54.348761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:54.364483 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:54.540139 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.568777 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425798097',display_name='tempest-ServerRescueNegativeTestJSON-server-425798097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-425798097',id=12,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:06Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-4pugocaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:06Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=55d556b2-785a-44cd-b996-ff93c203bacc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:54.570831 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "address": "fa:16:3e:47:52:02", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e41bccc-95", "ovs_interfaceid": "8e41bccc-9580-4bc4-b021-122855ecc2a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:54.571437 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:54.571689 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:54.572819 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.573026 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e41bccc-95, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:54.574083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.575170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:54.577146 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.577372 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67de7a42-3f35-4a10-b411-52ad32e93903) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:54.578822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.579429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:54.581093 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:54.583280 np0000000669 nova-compute[97951]: INFO os_vif [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:52:02,bridge_name='br-int',has_traffic_filtering=True,id=8e41bccc-9580-4bc4-b021-122855ecc2a9,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e41bccc-95')
May 13 04:16:54.583657 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Deleting instance files /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc_del
May 13 04:16:54.585145 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Deletion of /opt/stack/data/nova/instances/55d556b2-785a-44cd-b996-ff93c203bacc_del complete
May 13 04:16:54.712650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:54.713802 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:54.726411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:54.726683 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:54.756022 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:54.892697 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:55.093481 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 04:16:55.093957 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:16:55.094171 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:16:55.094268 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:16:55.094549 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:55.173566 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:55.217864 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:16:55.229086 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:55.396552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:16:55.736402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.541s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:55.785572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:55.785767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:55.789206 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:16:55.789206 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Claim successful on node np0000000669
May 13 04:16:55.816179 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Deleted allocations for instance f780fcc0-01e6-461f-868d-1dddd9fbc1b4
May 13 04:16:55.899625 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Creating tmpfile /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/tmpgb40yhjp to verify with other compute node that the instance is on the same shared storage. {{(pid=97951) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 13 04:16:55.899827 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:16:55.976829 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:16:56.013225 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.001293632999932015 future=<Future at 0x7a4648249580 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:56.013546 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645801.0118222, 2cf15625-daa9-41dd-b86a-1bddc18acfac => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:56.013673 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:56.013841 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] VM Stopped (Lifecycle Event)
May 13 04:16:56.014582 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.1101297359998625 future=<Future at 0x7a4648f0b890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:56.014697 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.11001436499987 future=<Future at 0x7a4648f0b890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:56.299717 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b3af8ae3-6058-447c-9a29-3e04a69d05ac req-3edb0c9f-00ee-4a7e-9e44-c64bb8975d39 service nova] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Received event network-vif-deleted-8e41bccc-9580-4bc4-b021-122855ecc2a9 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:56.395343 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.417588 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.421345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.438646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.442021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.460481 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.465534 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:56.478670 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Took 1.38 seconds to deallocate network for instance.
May 13 04:16:56.516174 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 2cf15625-daa9-41dd-b86a-1bddc18acfac] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:56.654436 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:56.654653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:56.654788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:56.654918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:56.655301 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:56.655664 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-8162d578-a65c-4dd2-b00f-04008d712e85 req-3692fa80-8485-45ed-9ddd-0b12e08c020c service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state resized and task_state resize_reverting.
May 13 04:16:56.725286 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99970458200005 future=<Future at 0x7a463c714890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:56.727305 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance destroyed successfully.
May 13 04:16:56.727839 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'resources' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:56.825952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9e8391a1-fdfb-4b73-a679-0a518eac9b60 tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "f780fcc0-01e6-461f-868d-1dddd9fbc1b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.686s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:56.985132 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:57.224549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:57.224789 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:57.230875 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:51Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:57.231098 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:57.231558 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:57.231742 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:57.232682 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:57.233009 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccaadeda-1f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:57.234906 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:57.236215 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:57.236881 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:57.237016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e59627e1-d74f-46f9-b111-4c8e3fd58dc0) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:57.238492 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:57.239820 np0000000669 nova-compute[97951]: INFO os_vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:16:57.240849 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:16:57.241109 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:16:57.241268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:16:57.311625 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.962s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:57.311831 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:57.312586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.338778 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsi session list stdout=tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.339044 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:57.339184 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '58')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:57.339279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '53')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:57.340103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96', '54')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:57.340929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648520b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:57.341148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:57.341427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Flush multipath device 33000000029c3a3fa {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:57.387992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:57.443974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:57.496583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:57.496583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:57.496583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:57.509314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:57.509534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:57.520812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.553770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.40.100,3260]
May 13 04:16:57.553770 np0000000669 nova-compute[97951]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.40.100,3260] successful.
May 13 04:16:57.553770 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.570372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.581830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.613889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.50.100,3260]
May 13 04:16:57.613889 np0000000669 nova-compute[97951]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-9b6ba802-ce3b-48f2-9bfb-14c9e6e6bf96, portal: 192.168.50.100,3260] successful.
May 13 04:16:57.613889 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.632933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.633157 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:57.633309 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] <== disconnect_volume: return (3284ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:57.633482 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:57.636300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.394s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:16:57.636300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:16:57.636300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9 (non-flash)
May 13 04:16:57.666793 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac302d0c-f0b1-425a-9a67-77d43bdb5fe9', '58')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '56')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '55')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c7074c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:16:57.666793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flush multipath device 330000000b896b8cb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:16:57.704484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:57.727421 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:57.746136 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:16:57.796965 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:16:57.797073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:16:57.797815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:16:57.808698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:16:57.808962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:16:57.820435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.853474 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:16:57.853474 np0000000669 nova-compute[97951]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:16:57.853474 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.870577 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.885249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.913918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:16:57.913918 np0000000669 nova-compute[97951]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:16:57.913918 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.931763 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:16:57.932034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:16:57.932203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== disconnect_volume: return (690ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:16:57.932386 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:16:58.125107 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00034081200010405155 future=<Future at 0x7a4648f0b890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.125796 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Emitting event <LifecycleEvent: 1778645803.1246405, dd0d182d-62d3-4878-8fcb-b987cdbb5e1f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:58.126122 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.126349 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] VM Stopped (Lifecycle Event)
May 13 04:16:58.127413 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.009161814999970375 future=<Future at 0x7a463c7f5dc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.127575 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.008986347000018213 future=<Future at 0x7a463c7f5dc0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.136966 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003598119999423943 future=<Future at 0x7a463c7f5dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.137633 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Emitting event <LifecycleEvent: 1778645803.1365008, 0c26601c-8a4a-49fd-bb81-a146023d95fb => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:16:58.137801 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] VM Stopped (Lifecycle Event)
May 13 04:16:58.138124 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.141141 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.135570517000133 future=<Future at 0x7a464858a5d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.141141 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=5.135443014999964 future=<Future at 0x7a464858a5d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:58.189604 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'flavor' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:58.235018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.449s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:58.235508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.250s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:58.235650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:16:58.439970 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:58.439970 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:58.440258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:58.440981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:58.441113 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:58.443148 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Terminating instance
May 13 04:16:58.628841 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b32ed71a-96e0-4b6c-87f0-06ab2be373b5 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: dd0d182d-62d3-4878-8fcb-b987cdbb5e1f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:58.649892 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4f4c1837-deff-4fd3-9bb0-b5e32e242ad1 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: 0c26601c-8a4a-49fd-bb81-a146023d95fb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:16:58.707523 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:16:58.707649 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:16:58.740667 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:58.740868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:58.741123 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:58.741218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:58.741379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:58.741528 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e7f59412-25f1-4173-b47e-f7d8ec5375bb req-dd0942db-40ac-4bb3-add6-8fbf7fbe9ed9 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state resized and task_state resize_reverting.
May 13 04:16:58.745628 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:16:58.746439 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:16:58.746927 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:58.747476 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:16:58.846920 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cf2542ae398407abdb47a235f3c8505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e441f4e3754f1692b7d4b86c603ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:16:58.950366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:16:58.969929 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:58.973538 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:58.997534 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:58.997534 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.026360 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.096725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:59.202995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b5b4787-a8a4-4442-8717-0cb61a9e0114 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:59.211140 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:16:59.246916 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:16:59.275815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.284789 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.306126 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99960725599999 future=<Future at 0x7a4648268470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:16:59.308704 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Instance destroyed successfully.
May 13 04:16:59.310019 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lazy-loading 'resources' on Instance uuid 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:16:59.504839 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:16:59.505520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:59.506331 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:59.506512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:59.506631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] No waiting events found dispatching network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:16:59.506729 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-18faee2f-5261-4ab2-a5b4-537907e7c769 req-81c22fd1-4097-487c-9a37-c04534ef8e43 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:16:59.553994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.599129 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:59.599129 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:59.599506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:16:59.599826 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:59.600029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:59.602618 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Terminating instance
May 13 04:16:59.722064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.487s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:16:59.724918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.626s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:16:59.754944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:16:59.813087 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1140428695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverbootfromvolumestablerescuetest-server-1140428695',id=14,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:06Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9bc4b864dd4763813e225868b7d67c',ramdisk_id='',reservation_id='r-65nvyot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-132730244',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:16Z,user_data=None,user_id='f077cae41c324b0bac3646dc90ca89a5',uuid=6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:16:59.813293 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converting VIF {"id": "1b0d75fc-5391-448b-820c-396c3a386431", "address": "fa:16:3e:6f:07:4b", "network": {"id": "9c3d999d-09db-40c9-a53f-e4d0c1aebc26", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1039788992-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a9bc4b864dd4763813e225868b7d67c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d75fc-53", "ovs_interfaceid": "1b0d75fc-5391-448b-820c-396c3a386431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:16:59.813719 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:16:59.813926 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:16:59.815465 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.817479 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Deleted allocations for instance 55d556b2-785a-44cd-b996-ff93c203bacc
May 13 04:16:59.820811 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b0d75fc-53, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:59.824377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.824377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:59.824377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.825525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.826741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f569a7a-fc24-43f9-ac68-695719287d79) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:16:59.826741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.827519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:16:59.827519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:16:59.829807 np0000000669 nova-compute[97951]: INFO os_vif [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=1b0d75fc-5391-448b-820c-396c3a386431,network=Network(9c3d999d-09db-40c9-a53f-e4d0c1aebc26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d75fc-53')
May 13 04:16:59.830076 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Deleting instance files /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5_del
May 13 04:16:59.830995 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Deletion of /opt/stack/data/nova/instances/6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5_del complete
May 13 04:16:59.852835 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Successfully created port: e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:17:00.106983 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:17:00.130074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.132841 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.158995 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.186874 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.187932 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.227689 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'migration_context' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:00.342157 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:17:00.343231 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:17:00.346150 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:17:00.346150 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:17:00.346150 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:00.469240 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:00.481646 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999674698000035 future=<Future at 0x7a461c7b0f20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:00.483032 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Instance destroyed successfully.
May 13 04:17:00.483740 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lazy-loading 'resources' on Instance uuid d2031784-5e1a-4659-9673-b16764bf8111 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:00.496953 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Successfully updated port: e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:17:00.503841 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:00.503914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:00.504339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:00.504481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:00.504603 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] No waiting events found dispatching network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:00.504811 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2c1c4d4c-af66-4ef3-b75d-a1f8975eb987 req-bdeca60d-60d7-4a18-a67f-d0c6352adf62 service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:00.729291 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Object Instance<9aea12d5-7e2c-4027-8bba-51aff967d2e0> lazy-loaded attributes: resources,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:17:00.765604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:17:00.766586 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:17:00.766845 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating image(s)
May 13 04:17:00.767374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:00.767638 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:00.768369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:00.768866 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:00.776495 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:00.782791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:00.802822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.848469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b4ae9be-8d63-4d25-8631-ee329e8af7ec tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "55d556b2-785a-44cd-b996-ff93c203bacc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.678s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:00.919062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.136s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:00.919499 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:00.920176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:00.920493 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:00.926861 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:00.926861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:00.987980 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168287781',display_name='tempest-AttachVolumeTestJSON-server-168287781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumetestjson-server-168287781',id=22,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD8XFC8etUXmOOJbfgUCofN9ZJyCf9OJd7aCyEfe8bSGkslFtXcDXEXeWHsEhAqpqRTL9ARWZ3OPXLQ0GVK/BAtZPIA9cJ904Luwtdsbil99Sq6zloJrm8P/JPR6vzKg==',key_name='tempest-keypair-1258349435',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:15:44Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32f6190e477e45ffb44a9f7754ab6965',ramdisk_id='',reservation_id='r-gwedwiet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777051046',owner_user_name='tempest-AttachVolumeTestJSON-1777051046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4d2a3b569e43219b9d28dfb3990758',uuid=d2031784-5e1a-4659-9673-b16764bf8111,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:17:00.988265 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converting VIF {"id": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "address": "fa:16:3e:d6:81:22", "network": {"id": "aeb8fb21-5070-4582-a771-f01fd3be68ba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1324630357-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32f6190e477e45ffb44a9f7754ab6965", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8ac866-d6", "ovs_interfaceid": "7d8ac866-d67a-4f7a-90ab-f456b3f1face", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:00.990115 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:00.990405 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:17:00.992312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.993342 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d8ac866-d6, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:00.994805 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.995277 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:00.995635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.996558 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.997845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40af0975-a791-4af9-bb76-c65a5fb2254b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:00.997845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:00.998304 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:01.000229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:01.000229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:01.000338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:01.000491 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:01.008427 np0000000669 nova-compute[97951]: INFO os_vif [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:22,bridge_name='br-int',has_traffic_filtering=True,id=7d8ac866-d67a-4f7a-90ab-f456b3f1face,network=Network(aeb8fb21-5070-4582-a771-f01fd3be68ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8ac866-d6')
May 13 04:17:01.009008 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Deleting instance files /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111_del
May 13 04:17:01.011062 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Deletion of /opt/stack/data/nova/instances/d2031784-5e1a-4659-9673-b16764bf8111_del complete
May 13 04:17:01.037732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:01.038268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:01.127529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk 1073741824" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:01.129709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:01.129709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:01.248154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.118s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:01.248866 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:17:01.249634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:01.348931 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:01.377521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:01.378030 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Cannot resize image /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:17:01.378356 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:17:01.378560 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Ensure instance console log exists: /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:17:01.378961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:01.379305 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:01.379522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:01.416250 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:01.416589 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:01.531345 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 04:17:01.531345 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:17:01.531345 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:17:01.531345 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:17:01.531345 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:01.622013 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:01.629439 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:01.630963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Acquiring lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:01.631835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:01.632425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:01.632584 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] No waiting events found dispatching network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:01.632704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-unplugged-1b0d75fc-5391-448b-820c-396c3a386431 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:01.632970 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:01.633167 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing instance network info cache due to event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:01.633294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:01.701842 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:01.702061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:01.702306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:01.702498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:01.702643 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:01.708083 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Terminating instance
May 13 04:17:01.768479 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:01.850640 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Took 1.51 seconds to deallocate network for instance.
May 13 04:17:01.865182 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:01.921286 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:02.095645 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:02.212457 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:17:02.230705 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.232655 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.263227 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.266912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.296578 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.297150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.361340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:02.527106 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:02.559731 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999655042999848 future=<Future at 0x7a4648564500 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:02.561744 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Instance destroyed successfully.
May 13 04:17:02.563632 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lazy-loading 'resources' on Instance uuid 82e032bf-0b06-4188-9792-cc2de6b15ab1 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:02.599689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:02.599689 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance network_info: |[{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:17:02.599689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:02.601949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start _get_guest_xml network_info=[{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:02.602513 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:02.612232 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:02.615517 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-517050181', uuid='895c0f15-772c-4b0f-a0b3-dc5469ce3508'), owner=OwnerMeta(userid='7cf2542ae398407abdb47a235f3c8505', username='tempest-AttachVolumeShelveTestJSON-173127407-project-member', projectid='94e441f4e3754f1692b7d4b86c603ca8', projectname='tempest-AttachVolumeShelveTestJSON-173127407'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645822.6146662) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:02.620825 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:02.625267 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:02.626677 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:02.626995 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:02.628179 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:02.628811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:02.629496 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:02.630378 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:02.633196 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:02.633485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] Acquiring lock "d2031784-5e1a-4659-9673-b16764bf8111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:02.633673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:02.633894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] Lock "d2031784-5e1a-4659-9673-b16764bf8111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:02.634061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] No waiting events found dispatching network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:02.634203 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-unplugged-7d8ac866-d67a-4f7a-90ab-f456b3f1face for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:02.634381 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad2300ce-7886-4cd4-a690-f032235e7741 req-9172af93-4d40-46f9-a26a-5d8ba193ccde service nova] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Received event network-vif-deleted-1b0d75fc-5391-448b-820c-396c3a386431 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:02.635098 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:02.635262 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:02.635423 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:02.635606 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:02.635726 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:02.635856 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:02.635965 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:02.636110 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:02.650200 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYmyFtnd1eLID1EsfTwvaras4CcC8UsQP9RdC13+DKK43Y/vzmRVw1KFJ0lappqbALhb4+6211tufaRF9DIVglBJNbtdud5OUZ21p/5r5kiqDkAxRjH/CBV19O8hp6hhA==',key_name='tempest-keypair-844275117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:02.650516 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:02.651492 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:02.652102 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_devices' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:02.752194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:02.752473 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:02.752678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:02.753059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:02.753808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:02.754040 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6b7688ac-a78d-4bf5-a763-c0b65cbfe7ee req-fa88d82c-fc5e-4f71-9110-ef7824339af8 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:02.943967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.222s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:02.944203 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:17:02.960018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.598s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:02.986917 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.067241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133651706',display_name='tempest-ServerRescueNegativeTestJSON-server-133651706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverrescuenegativetestjson-server-133651706',id=11,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:14:21Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dd34c67006f4acc8b1a4ffc4bb599c1',ramdisk_id='',reservation_id='r-8d4yz1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1023276944',owner_user_name='tempest-ServerRescueNegativeTestJSON-1023276944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:14:29Z,user_data=None,user_id='0549cd57d1904853bbc5ac5116ea7f42',uuid=82e032bf-0b06-4188-9792-cc2de6b15ab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:17:03.067489 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converting VIF {"id": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "address": "fa:16:3e:8f:2e:6c", "network": {"id": "d2db17ad-912d-4ccf-a1a2-6cd2c3b78394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-31591874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dd34c67006f4acc8b1a4ffc4bb599c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1a26a8-6c", "ovs_interfaceid": "8a1a26a8-6c0b-4008-b136-c7a0537572af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:03.068539 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:03.068895 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:17:03.070468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.070717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a1a26a8-6c, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.073033 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.073816 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:03.075274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.075597 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cd2b89e-bc2c-4d0c-a569-1c23a741f992) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.075994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.076605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:03.078430 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.081188 np0000000669 nova-compute[97951]: INFO os_vif [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=8a1a26a8-6c0b-4008-b136-c7a0537572af,network=Network(d2db17ad-912d-4ccf-a1a2-6cd2c3b78394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1a26a8-6c')
May 13 04:17:03.081485 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Deleting instance files /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1_del
May 13 04:17:03.082276 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Deletion of /opt/stack/data/nova/instances/82e032bf-0b06-4188-9792-cc2de6b15ab1_del complete
May 13 04:17:03.108046 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:03.156032 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <uuid>895c0f15-772c-4b0f-a0b3-dc5469ce3508</uuid>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <name>instance-0000001b</name>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-517050181</nova:name>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:02</nova:creationTime>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:user uuid="7cf2542ae398407abdb47a235f3c8505">tempest-AttachVolumeShelveTestJSON-173127407-project-member</nova:user>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:project uuid="94e441f4e3754f1692b7d4b86c603ca8">tempest-AttachVolumeShelveTestJSON-173127407</nova:project>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         <nova:port uuid="e8c562a0-eb26-4e3a-a170-8f1da7a57976">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="serial">895c0f15-772c-4b0f-a0b3-dc5469ce3508</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="uuid">895c0f15-772c-4b0f-a0b3-dc5469ce3508</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:bd:76:53"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <target dev="tape8c562a0-eb"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/console.log" append="off"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:03.156032 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Preparing to wait for external event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYmyFtnd1eLID1EsfTwvaras4CcC8UsQP9RdC13+DKK43Y/vzmRVw1KFJ0lappqbALhb4+6211tufaRF9DIVglBJNbtdud5OUZ21p/5r5kiqDkAxRjH/CBV19O8hp6hhA==',key_name='tempest-keypair-844275117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:03.158588 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:03.159355 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:03.159962 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:03.160550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.160829 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.160990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:03.163007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.163229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3478435e-1e97-5498-bed9-41afb392d5d7', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.164120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.165660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:03.166863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.171347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.171347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c562a0-eb, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.171347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c562a0-eb, col_values=(('qos', UUID('b7d30117-f6c9-47e3-90ca-6c53abfcd6a7')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.171347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c562a0-eb, col_values=(('external_ids', {'iface-id': 'e8c562a0-eb26-4e3a-a170-8f1da7a57976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:76:53', 'vm-uuid': '895c0f15-772c-4b0f-a0b3-dc5469ce3508'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:03.175529 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.176943 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:03.183510 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:03.185184 np0000000669 nova-compute[97951]: INFO os_vif [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb')
May 13 04:17:03.276734 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00042004500005532464 future=<Future at 0x7a464858a5d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:03.278124 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:03.278124 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.9544472359998508 future=<Future at 0x7a464827fb90 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:03.278124 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.954311799999914 future=<Future at 0x7a464827fb90 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:03.278124 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645808.2762249, 8d2f3521-15f2-4140-9561-7798bbe03f60 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:03.278124 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] VM Stopped (Lifecycle Event)
May 13 04:17:03.496413 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:03.496691 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:03.590801 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 04:17:03.591573 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:17:03.591853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:17:03.591973 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:17:03.592265 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:03.644450 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:03.785370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 8d2f3521-15f2-4140-9561-7798bbe03f60] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:03.818542 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updated VIF entry in instance network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:17:03.818785 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:03.838470 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:03.843663 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:03.999674 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:04.163003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be723fc4-7476-44bb-ae00-eb24a56f1fd2 req-12fda241-cbff-4ab3-8701-4f183a722e36 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-deleted-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:04.163104 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-be723fc4-7476-44bb-ae00-eb24a56f1fd2 req-12fda241-cbff-4ab3-8701-4f183a722e36 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Neutron deleted interface 8a1a26a8-6c0b-4008-b136-c7a0537572af; detaching it from the instance and deleting it from the info cache
May 13 04:17:04.163279 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-be723fc4-7476-44bb-ae00-eb24a56f1fd2 req-12fda241-cbff-4ab3-8701-4f183a722e36 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:04.320825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8112d2d-c968-4538-8599-b3df4791770f req-29e61b8a-7b6c-49b6-88a6-d4c662ee47a1 service nova] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:04.348271 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Took 2.82 seconds to deallocate network for instance.
May 13 04:17:04.507867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.548s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:04.542502 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Swapping old allocation on dict_keys(['7fc6428b-bc57-40b4-8243-357124d5276c']) held by migration 11ed76e1-18c3-445a-b1a9-c38b6dd39d10 for instance
May 13 04:17:04.558157 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:04.580007 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Deleted allocations for instance 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5
May 13 04:17:04.615461 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:04.658909 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Overwriting current allocation {'allocations': {'7fc6428b-bc57-40b4-8243-357124d5276c': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 35}}, 'project_id': 'e7a830770c9b4796a5794a565f5f9336', 'user_id': 'bcc80bf8624b4787ad074f10f73872a8', 'consumer_generation': 1} on consumer 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 13 04:17:04.668313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be723fc4-7476-44bb-ae00-eb24a56f1fd2 req-12fda241-cbff-4ab3-8701-4f183a722e36 service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Detach interface failed, port_id=8a1a26a8-6c0b-4008-b136-c7a0537572af, reason: Instance 82e032bf-0b06-4188-9792-cc2de6b15ab1 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:17:04.713428 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:04.713569 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:04.713690 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No VIF found with MAC fa:16:3e:bd:76:53, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:04.714160 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Using config drive
May 13 04:17:04.757536 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:04.844484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:04.844610 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquired lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:04.844787 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:04.850728 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Received event network-vif-deleted-7d8ac866-d67a-4f7a-90ab-f456b3f1face {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:04.850728 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:04.850948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] Acquiring lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:04.851084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:04.851191 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:04.851340 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] No waiting events found dispatching network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:04.851526 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c8adaae9-f0f5-4fcd-8d74-c00854790edc req-3b51a8b1-0eb7-4693-a8b0-d7cbdb727bae service nova] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Received event network-vif-unplugged-8a1a26a8-6c0b-4008-b136-c7a0537572af for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:04.857296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:04.857296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:05.120557 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Took 1.53 seconds to deallocate network for instance.
May 13 04:17:05.160451 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:05.160934 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:05.219907 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:05.231826 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003764719999708177 future=<Future at 0x7a464827fb90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:05.231975 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:05.232076 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.8294193310000537 future=<Future at 0x7a464809d220 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:05.232154 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.8293246380001165 future=<Future at 0x7a464809d220 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:05.232804 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645810.2313354, f780fcc0-01e6-461f-868d-1dddd9fbc1b4 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:05.232946 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] VM Stopped (Lifecycle Event)
May 13 04:17:05.347371 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:05.372312 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating config drive at /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config
May 13 04:17:05.378782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3nh0ylj7 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:05.434765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3nh0ylj7" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:05.592820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-97e25d55-365b-46ae-9fc7-03d3f36afafe tempest-ServerBootFromVolumeStableRescueTest-132730244 tempest-ServerBootFromVolumeStableRescueTest-132730244-project-member] Lock "6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.153s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:05.627249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:05.664283 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:05.740269 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: f780fcc0-01e6-461f-868d-1dddd9fbc1b4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:05.772727 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:05.973528 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:05.999082 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:06.006708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:06.118409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:06.174350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.316s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:06.175748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.548s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:06.235633 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10402538-3be7-4a5e-9843-539eadbd5774 req-0bd1e911-e900-4bc7-8e99-4ef12d0d57dc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:06.236384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10402538-3be7-4a5e-9843-539eadbd5774 req-0bd1e911-e900-4bc7-8e99-4ef12d0d57dc service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:06.236384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10402538-3be7-4a5e-9843-539eadbd5774 req-0bd1e911-e900-4bc7-8e99-4ef12d0d57dc service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:06.238069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10402538-3be7-4a5e-9843-539eadbd5774 req-0bd1e911-e900-4bc7-8e99-4ef12d0d57dc service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:06.238069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10402538-3be7-4a5e-9843-539eadbd5774 req-0bd1e911-e900-4bc7-8e99-4ef12d0d57dc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Processing event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:17:06.283253 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Deleted allocations for instance d2031784-5e1a-4659-9673-b16764bf8111
May 13 04:17:06.370491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:06.402228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:06.503001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Releasing lock "refresh_cache-9aea12d5-7e2c-4027-8bba-51aff967d2e0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:06.503538 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:06.521708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:17:06.547714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:06.580818 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:06.581216 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:06.591598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:17:06.592091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:17:06.604383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:17:06.605573 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:febd:7653', 'fe80::c0fb:9ff:fee9:b80'] 
May 13 04:17:06.605749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:17:06.605895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:17:06.606115 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:06.675435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:06.676561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:07.013553 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:17:07.014449 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645827.0139606, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:07.021157 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Started (Lifecycle Event)
May 13 04:17:07.021157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:17:07.021157 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance spawned successfully.
May 13 04:17:07.021157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:17:07.086053 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:07.179602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:17:07.294204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1e0573f7-31a6-43be-add6-7fc457e3f868 tempest-AttachVolumeTestJSON-1777051046 tempest-AttachVolumeTestJSON-1777051046-project-member] Lock "d2031784-5e1a-4659-9673-b16764bf8111" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.695s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:07.339473 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:07.517782 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:07.520539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:07.527237 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.527549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.527937 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.528309 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.528732 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.529116 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:07.592921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.417s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:07.666655 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Deleted allocations for instance 82e032bf-0b06-4188-9792-cc2de6b15ab1
May 13 04:17:07.729527 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Starting finish_revert_migration {{(pid=97951) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 13 04:17:07.738888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:07.739076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:07.746605 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:17:07.747242 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Claim successful on node np0000000669
May 13 04:17:07.753105 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start _get_guest_xml network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '9aea12d5-7e2c-4027-8bba-51aff967d2e0', 'attached_at': '2026-05-13T04:17:07.000000', 'detached_at': '', 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'serial': '99367786-ac0d-4955-a3d0-5375f71bc972'}, 'disk_bus': 'virtio', 'attachment_id': 'b46386b0-8256-4e8f-a15a-5716d65cf92f', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:07.754955 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:07.756587 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2054040936', uuid='9aea12d5-7e2c-4027-8bba-51aff967d2e0'), owner=OwnerMeta(userid='bcc80bf8624b4787ad074f10f73872a8', username='tempest-ServerActionsTestOtherB-1906736706-project-member', projectid='e7a830770c9b4796a5794a565f5f9336', projectname='tempest-ServerActionsTestOtherB-1906736706'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645827.756256) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:07.758186 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:07.758507 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:07.759643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:07.759772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:07.760659 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:07.760883 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:07.761020 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:07.761107 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:07.761214 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:07.761297 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:07.761449 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:07.762233 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:08.024786 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:17:08.025043 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645828.0248742, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:08.025174 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Paused (Lifecycle Event)
May 13 04:17:08.036314 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Took 7.27 seconds to spawn the instance on the hypervisor.
May 13 04:17:08.036314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:08.175180 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:08.284850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:08.330847 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:08.331273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:08.332775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:08.332775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:08.332775 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:08.332775 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7736f9b7-89ff-44ae-8dc5-3536c210904f req-84bd6939-1109-4da3-99d5-372f03d19257 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received unexpected event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with vm_state active and task_state None.
May 13 04:17:08.405028 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config --force-share --output=json" returned: 0 in 0.120s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:08.405538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:08.405746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:08.406408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:08.406825 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:17:08.407300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:08.407487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:08.407891 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:08.408144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:17:08.420834 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:08.421778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:08.422441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:08.422904 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:08.423129 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:08.423662 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:08.439249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:08.439249 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:08.444995 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:08.444995 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:08.453435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:17:08.453435 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:08.453435 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:08.453435 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:08.453435 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:08.453435 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:08.453435 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:08.453770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:08.453896 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:08.454000 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:08.465127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972] added
May 13 04:17:08.465127 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:08.465127 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:08.465127 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:08.465127 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:08.465127 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:08.465127 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:08.465393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:08.465771 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:08.467093 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:08.531118 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:08.534604 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645828.5341375, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:08.534931 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Resumed (Lifecycle Event)
May 13 04:17:08.553505 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Took 12.83 seconds to build instance.
May 13 04:17:08.676853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71cbc72d-f1f2-41d6-bbe6-cfb884624f94 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Lock "82e032bf-0b06-4188-9792-cc2de6b15ab1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.975s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:09.039173 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:09.045687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:09.048051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:09.048263 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:09.055082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df1a04a0-d8cb-4f6a-81c8-93891b9efaea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.342s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:09.061970 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004338920000463986 future=<Future at 0x7a464809d220 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:09.063165 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Emitting event <LifecycleEvent: 1778645814.0614333, 55d556b2-785a-44cd-b996-ff93c203bacc => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:09.063382 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:09.063619 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] VM Stopped (Lifecycle Event)
May 13 04:17:09.063774 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.661238123999965 future=<Future at 0x7a463c714890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:09.065963 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.659002469999905 future=<Future at 0x7a463c714890 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:09.375061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:09.454687 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:09.468353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.468353 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:09.480996 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:09.480996 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.489763 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.496407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.503933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:17:09.503933 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:09.504100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:17:09.504100 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:09.504298 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:17:09.504298 np0000000669 nova-compute[97951]: 
May 13 04:17:09.514995 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:17:09.514995 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:09.514995 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:17:09.514995 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:09.515222 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:17:09.515222 np0000000669 nova-compute[97951]: 
May 13 04:17:09.540315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:17:09.540315 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:17:09.540315 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.551521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.555300 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:09.563894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:17:09.563894 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:17:09.563894 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.566099 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:09.569722 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 55d556b2-785a-44cd-b996-ff93c203bacc] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:09.572822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.572822 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.572822 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.575862 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('7', '-', '-', 0) found on session 59 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:09.575862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:09.589749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:09.605286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 59 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:09.605286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:09.609360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.609360 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.609360 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:09.609579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.609579 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:09.609579 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:09.609778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:09.609948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:09.611187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] HCTL ('8', '-', '-', 0) found on session 60 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:09.611549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:09.632191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Searching for a device in session 60 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:09.632191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:09.976974 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:09.979034 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing instance network info cache due to event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:09.979034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:09.979034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:09.979197 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:10.072176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.333s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:10.072652 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:17:10.423117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:17:10.483589 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:10.581120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:17:10.581418 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:17:10.581739 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:10.582053 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:10.591679 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:10.731260 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a537cfdbd3cb43b885ae21a9db152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b639861ec44659ada64bddafc7172d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:17:11.080197 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:17:11.445158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Found WWN 330000000b896b8cb for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:17:11.445516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:11.446612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-0', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:11.446612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b896b8cb', 'path': '/dev/dm-0', 'multipath_id': '330000000b896b8cb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:17:11.459249 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Successfully created port: 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:17:11.583650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:17:11.725751 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000745688000051814 future=<Future at 0x7a463c714890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:11.726413 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645816.7248955, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:11.728567 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:11.728567 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.57894470500014 future=<Future at 0x7a4648268470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:11.728567 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.5788442510001914 future=<Future at 0x7a4648268470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:11.729074 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Stopped (Lifecycle Event)
May 13 04:17:11.803694 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:11.855048 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:11.856716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:11.954762 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:51Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:11.954970 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:11.955777 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:11.958561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <uuid>9aea12d5-7e2c-4027-8bba-51aff967d2e0</uuid>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <name>instance-00000015</name>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsTestOtherB-server-2054040936</nova:name>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:07</nova:creationTime>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:user uuid="bcc80bf8624b4787ad074f10f73872a8">tempest-ServerActionsTestOtherB-1906736706-project-member</nova:user>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:project uuid="e7a830770c9b4796a5794a565f5f9336">tempest-ServerActionsTestOtherB-1906736706</nova:project>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         <nova:port uuid="ccaadeda-1fb5-45f0-8390-231d698576c4">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="serial">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="uuid">9aea12d5-7e2c-4027-8bba-51aff967d2e0</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/disk.config"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <alias name="ua-99367786-ac0d-4955-a3d0-5375f71bc972"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <serial>99367786-ac0d-4955-a3d0-5375f71bc972</serial>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:71:ea:9d"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <target dev="tapccaadeda-1f"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0/console.log" append="off"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:11.958561 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Preparing to wait for external event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:51Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:11.961137 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:11.961476 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:11.961932 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:11.962491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.963680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:11.964089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:11.965892 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.965892 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03dbe99b-d0d7-5329-9e5e-d8a22af5c471', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:11.966281 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.967044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:11.967787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.970998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.970998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccaadeda-1f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:11.970998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccaadeda-1f, col_values=(('qos', UUID('d5dfedf6-7b31-467c-bedb-eb87e455f3ad')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:11.970998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccaadeda-1f, col_values=(('external_ids', {'iface-id': 'ccaadeda-1fb5-45f0-8390-231d698576c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ea:9d', 'vm-uuid': '9aea12d5-7e2c-4027-8bba-51aff967d2e0'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:11.971470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.973113 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:11.981927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:11.985922 np0000000669 nova-compute[97951]: INFO os_vif [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:17:12.004545 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updated VIF entry in instance network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:17:12.004814 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:12.055375 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Successfully updated port: 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:17:12.115989 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:12.116214 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing instance network info cache due to event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:12.116468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:12.117701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:12.118353 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:12.233889 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:12.362731 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:12.507782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ff19fcbd-3010-4f8f-8021-cfdfc7e0a4d1 req-42d68414-c49d-4889-9259-1e66ec172b28 service nova] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:12.511970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.542056 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.558855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:12.592759 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:17:12.593833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:17:12.594929 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Creating image(s)
May 13 04:17:12.594929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:12.595097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:12.595759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:12.596455 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:12.601169 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:12.602861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:12.630682 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:12.645394 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.728294 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:12.733247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.126s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:12.733794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:12.734438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:12.734819 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:12.738165 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:12.738500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:12.863090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.124s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:12.863854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:12.915986 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.920713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.925738 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:12.944351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk 1073741824" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:12.944351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:12.944351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:12.964064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:13.051907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:13.056823 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:13.059299 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:17:13.060479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:13.189302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:13.190791 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Cannot resize image /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:17:13.190791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:17:13.190791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Ensure instance console log exists: /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:17:13.190979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:13.191268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:13.191556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:13.277982 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-598409e6-65b3-4af7-aa71-2222c599a5a8 req-a71a769e-f3ea-4940-a49a-6e90e8e2b4bb service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:13.278649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-598409e6-65b3-4af7-aa71-2222c599a5a8 req-a71a769e-f3ea-4940-a49a-6e90e8e2b4bb service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:13.278818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-598409e6-65b3-4af7-aa71-2222c599a5a8 req-a71a769e-f3ea-4940-a49a-6e90e8e2b4bb service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:13.278947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-598409e6-65b3-4af7-aa71-2222c599a5a8 req-a71a769e-f3ea-4940-a49a-6e90e8e2b4bb service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:13.279083 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-598409e6-65b3-4af7-aa71-2222c599a5a8 req-a71a769e-f3ea-4940-a49a-6e90e8e2b4bb service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Processing event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:17:13.396887 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.542s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:13.481202 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645833.479206, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:13.481817 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:17:13.482015 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Started (Lifecycle Event)
May 13 04:17:13.488774 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance running successfully.
May 13 04:17:13.489972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] finish_revert_migration finished successfully. {{(pid=97951) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 13 04:17:13.560538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-978712cb-d2a3-45ac-9fb5-b2a81eef28b8 req-eb2a1aa6-4bf2-40fe-95b7-c48ee3eaf18d service nova] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:13.560944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:13.561291 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:13.985124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:13.988820 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:14.102030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:14.137633 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:14.306555 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00044266800000514195 future=<Future at 0x7a4648268470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:14.306555 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:14.306555 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1748492760000318 future=<Future at 0x7a461c7b0f20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:14.306555 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1747401170000558 future=<Future at 0x7a461c7b0f20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:14.307087 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] Emitting event <LifecycleEvent: 1778645819.3055992, 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:14.307258 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] VM Stopped (Lifecycle Event)
May 13 04:17:14.445532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:14.445532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:14.445532 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Attaching volume 36055a9b-69dd-44bc-b37b-45142850db35 to /dev/vdb
May 13 04:17:14.472766 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:14.476249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:14.493862 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 13 04:17:14.494123 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645834.4939497, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:14.494255 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Paused (Lifecycle Event)
May 13 04:17:14.510692 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:14.528286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:17:14.564385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:14.589113 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:14.599760 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c083c268-6cbd-42e0-a0f8-a9356f489778 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance to original state: 'active'
May 13 04:17:14.620228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:17:14.622180 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:17:14.639422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:17:14.642881 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:febd:7653', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fe71:ea9d', 'fe80::3c8f:4ff:fe1e:23c5'] 
May 13 04:17:14.643256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:17:14.644243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:17:14.644243 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:14.644243 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating existing volume attachment record: 088725b5-924d-4ba2-94f1-5db3ceaa5d4c {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:17:14.764138 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:14.813664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2f715055-f1f7-4671-a995-5d3b31c226fb tempest-TestMultiAttachVolumeSwap-540647060 tempest-TestMultiAttachVolumeSwap-540647060-project-member] [instance: 6ebd2b35-67bb-4ff5-af7f-c2bb8b135ea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:14.996805 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:14.999371 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645834.999068, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:14.999562 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Resumed (Lifecycle Event)
May 13 04:17:15.220960 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:17:15.221409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:15.221609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:15.222093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:15.222560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:17:15.235806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:15.236519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:15.237030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:15.237284 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:15.237733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:15.237906 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:15.249402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:15.249402 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:15.258081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:15.258081 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35] added
May 13 04:17:15.264858 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:15.264858 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:15.264858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:15.266008 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:15.266964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:15.267374 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:15.267879 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance network_info: |[{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:17:15.269997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start _get_guest_xml network_info=[{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:15.271224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35] added
May 13 04:17:15.271224 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:15.271224 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:15.271224 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:15.271224 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:15.271224 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:15.271224 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:15.271502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:15.271696 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:15.271883 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:15.274489 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:15.276093 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-549655183', uuid='a26ca192-6544-4d60-b566-17ee3d91bff7'), owner=OwnerMeta(userid='a537cfdbd3cb43b885ae21a9db152e57', username='tempest-ServerStableDeviceRescueTest-1671909926-project-member', projectid='e3b639861ec44659ada64bddafc7172d', projectname='tempest-ServerStableDeviceRescueTest-1671909926'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645835.2756855) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:15.277143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:15.277634 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:15.278935 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:15.279150 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:15.280607 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:15.280963 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:15.281103 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:15.281189 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:15.281371 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:15.281528 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:15.281686 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:15.281915 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:15.282050 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:15.282225 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:15.282332 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:15.283623 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:15.305765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-549655183',display_name='tempest-ServerStableDeviceRescueTest-server-549655183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverstabledevicerescuetest-server-549655183',id=28,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgGn+ovjMLs5pEgOfAzTUALf/n8SK8axWsTN6Ncx3rTPNBqiUZTcgp6rhT6ZtmtGrKZu5xErsOEsk9yIO1jWkY8+BJTsq5AcaMnENkInWTjD09DKcS4QrGSFGvE+Q4OYQ==',key_name='tempest-keypair-1545026129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b639861ec44659ada64bddafc7172d',ramdisk_id='',reservation_id='r-penoq4kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1671909926',owner_user_name='tempest-ServerStableDeviceRescueTest-1671909926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a537cfdbd3cb43b885ae21a9db152e57',uuid=a26ca192-6544-4d60-b566-17ee3d91bff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:15.305990 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converting VIF {"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:15.306841 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:15.307858 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'pci_devices' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:15.354040 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:15.354040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:15.354040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:15.354040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:15.354164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:15.354233 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-819cae43-aba4-472d-8b0f-55b0a238a79d req-b5acad58-98b0-47d6-aaf4-b6cbbd374ada service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received unexpected event network-vif-plugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with vm_state active and task_state None.
May 13 04:17:15.481764 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00043896399984078016 future=<Future at 0x7a461c7b0f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:15.481974 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:15.481974 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.0772842839999157 future=<Future at 0x7a4648564500 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:15.484085 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.0771780019999824 future=<Future at 0x7a4648564500 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:15.484085 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Emitting event <LifecycleEvent: 1778645820.4812114, d2031784-5e1a-4659-9673-b16764bf8111 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:15.484085 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] VM Stopped (Lifecycle Event)
May 13 04:17:15.502066 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:15.506751 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:15.811708 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <uuid>a26ca192-6544-4d60-b566-17ee3d91bff7</uuid>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <name>instance-0000001c</name>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-549655183</nova:name>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:15</nova:creationTime>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:user uuid="a537cfdbd3cb43b885ae21a9db152e57">tempest-ServerStableDeviceRescueTest-1671909926-project-member</nova:user>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:project uuid="e3b639861ec44659ada64bddafc7172d">tempest-ServerStableDeviceRescueTest-1671909926</nova:project>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         <nova:port uuid="2999b0b3-03bf-4a9d-b6c5-0598f57f69ee">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="serial">a26ca192-6544-4d60-b566-17ee3d91bff7</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="uuid">a26ca192-6544-4d60-b566-17ee3d91bff7</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a1:eb:fc"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <target dev="tap2999b0b3-03"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/console.log" append="off"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:15.811708 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:15.811708 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Preparing to wait for external event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:15.815370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:15.815370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:15.815370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:15.815370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-549655183',display_name='tempest-ServerStableDeviceRescueTest-server-549655183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverstabledevicerescuetest-server-549655183',id=28,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgGn+ovjMLs5pEgOfAzTUALf/n8SK8axWsTN6Ncx3rTPNBqiUZTcgp6rhT6ZtmtGrKZu5xErsOEsk9yIO1jWkY8+BJTsq5AcaMnENkInWTjD09DKcS4QrGSFGvE+Q4OYQ==',key_name='tempest-keypair-1545026129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b639861ec44659ada64bddafc7172d',ramdisk_id='',reservation_id='r-penoq4kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1671909926',owner_user_name='tempest-ServerStableDeviceRescueTest-1671909926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a537cfdbd3cb43b885ae21a9db152e57',uuid=a26ca192-6544-4d60-b566-17ee3d91bff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:15.815370 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converting VIF {"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:15.815826 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:15.816470 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:15.816870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.817243 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:15.817620 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:15.821359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.821359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6b46248-456a-58ed-9e5b-3f220db7911b', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:15.823235 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.824289 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:15.826992 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.827200 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2999b0b3-03, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:15.828356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2999b0b3-03, col_values=(('qos', UUID('d74fc1b0-4fbd-4ecc-94c9-182c89f0c106')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:15.828356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2999b0b3-03, col_values=(('external_ids', {'iface-id': '2999b0b3-03bf-4a9d-b6c5-0598f57f69ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:eb:fc', 'vm-uuid': 'a26ca192-6544-4d60-b566-17ee3d91bff7'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:15.829525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.831088 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:15.836676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:15.837953 np0000000669 nova-compute[97951]: INFO os_vif [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03')
May 13 04:17:15.986922 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: d2031784-5e1a-4659-9673-b16764bf8111] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:16.268679 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:16.275453 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:16.285691 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:16.285691 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:16.296689 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:16.296689 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.302581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.313847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.322371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.322371 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.322371 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:16.322371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.322371 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.322371 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:16.329855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.329855 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.329855 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:16.330021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.330021 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.330021 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:16.359341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.40.100,3260]
May 13 04:17:16.359341 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.40.100,3260] successful.
May 13 04:17:16.359341 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.364686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.50.100,3260]
May 13 04:17:16.364686 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.50.100,3260] successful.
May 13 04:17:16.364686 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.373204 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.379523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:16.393189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.393189 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.393189 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.393189 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.393189 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:16.393410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.393410 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.393410 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.393410 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.393410 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:16.393692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:16.393797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:16.394361 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.394361 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.394361 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.394361 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.394361 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:16.394644 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.394644 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:16.394644 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.394644 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:16.394644 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:16.394855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:16.395115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:16.396408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('9', '-', '-', 0) found on session 61 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:16.396408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:16.396671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('10', '-', '-', 0) found on session 62 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:16.396770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:16.419237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 61 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:16.419237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:16.421940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 62 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:16.422196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:17.080640 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:17.080775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:17.080928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:17.081049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:17.081166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:17.083898 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:17.084750 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Terminating instance
May 13 04:17:17.087271 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:17.237537 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:17:17.299922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.367899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:17.370348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:17.370348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No VIF found with MAC fa:16:3e:a1:eb:fc, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:17.370348 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Using config drive
May 13 04:17:17.561766 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.002423398000019006 future=<Future at 0x7a4648564500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:17.562286 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] Emitting event <LifecycleEvent: 1778645822.5591965, 82e032bf-0b06-4188-9792-cc2de6b15ab1 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:17.562482 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:17.562610 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] VM Stopped (Lifecycle Event)
May 13 04:17:17.592519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:17:17.618608 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.622849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.643563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.645806 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.674182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:17.837943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cd3388e3-6f11-4c2e-bc6e-d10c2a4cfe3b req-62d2102d-da9d-42c1-bd07-e3b6243dbd76 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:17.879808 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:17.949481 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999684677000005 future=<Future at 0x7a4648102d20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:17.950045 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999114210000016 future=<Future at 0x7a4648102d20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:17.950156 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998976089000053 future=<Future at 0x7a4648102d20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:17.954985 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Instance destroyed successfully.
May 13 04:17:17.955537 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lazy-loading 'resources' on Instance uuid 9aea12d5-7e2c-4027-8bba-51aff967d2e0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:18.066865 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-27af0008-57ac-4d98-bfcd-b4022b98b9ca tempest-VolumesAdminNegativeTest-1693197836 tempest-VolumesAdminNegativeTest-1693197836-project-member] [instance: 82e032bf-0b06-4188-9792-cc2de6b15ab1] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:18.074421 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Creating config drive at /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config
May 13 04:17:18.082343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbf5hphzq {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:18.137065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbf5hphzq" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:18.255761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found WWN 3300000005e7268bb for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:17:18.257707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:18.257874 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000005e7268bb', 'path': '/dev/dm-1', 'multipath_id': '3300000005e7268bb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:18.258083 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005e7268bb', 'path': '/dev/dm-1', 'multipath_id': '3300000005e7268bb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:17:18.260810 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:18.461021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2054040936',display_name='tempest-ServerActionsTestOtherB-server-2054040936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionstestotherb-server-2054040936',id=21,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9jc6t2wETSzlKcpvHM237svBMWvdmx3OmvEkqRbR8ha+HD5vMGIdEM4PO/Nm1Em2EPyVnewzNj2l91xlKgkAo2Tj3iAewHvVdIQ8UTExlfh26vd14+LMoQdDfqYcJTJA==',key_name='tempest-keypair-1860544647',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7a830770c9b4796a5794a565f5f9336',ramdisk_id='',reservation_id='r-0tfn1qrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1906736706',owner_user_name='tempest-ServerActionsTestOtherB-1906736706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcc80bf8624b4787ad074f10f73872a8',uuid=9aea12d5-7e2c-4027-8bba-51aff967d2e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:17:18.461597 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converting VIF {"id": "ccaadeda-1fb5-45f0-8390-231d698576c4", "address": "fa:16:3e:71:ea:9d", "network": {"id": "24e7001e-abab-4c96-a247-77f806e087db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-35194995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7a830770c9b4796a5794a565f5f9336", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccaadeda-1f", "ovs_interfaceid": "ccaadeda-1fb5-45f0-8390-231d698576c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:18.461876 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:18.462103 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:17:18.463395 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.463649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccaadeda-1f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:18.465136 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.466194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:18.470206 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.471460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.471460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5dfedf6-7b31-467c-bedb-eb87e455f3ad) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:18.471752 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.472244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:18.478195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.480675 np0000000669 nova-compute[97951]: INFO os_vif [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ea:9d,bridge_name='br-int',has_traffic_filtering=True,id=ccaadeda-1fb5-45f0-8390-231d698576c4,network=Network(24e7001e-abab-4c96-a247-77f806e087db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccaadeda-1f')
May 13 04:17:18.482761 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:17:18.483087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:18.483253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:18.483660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:18.483926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99367786-ac0d-4955-a3d0-5375f71bc972', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:17:18.484061 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:17:18.519659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:18.519659 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:18.519659 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:18.519659 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:18.519659 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:18.519968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsi session list stdout=tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:18.519968 np0000000669 nova-compute[97951]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972 (non-flash)
May 13 04:17:18.519968 np0000000669 nova-compute[97951]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:18.519968 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:18.519968 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:18.520161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '62')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:17:18.520260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '59')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:17:18.521824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972', '60')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:17:18.522316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46483be520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:17:18.523717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:17:18.523717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Flush multipath device 330000000b896b8cb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:17:18.566051 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:17:18.618923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.626829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:17:18.649229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.667950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:17:18.668153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:17:18.669006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:17:18.684069 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:17:18.684230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:17:18.699307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.734645 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260]
May 13 04:17:18.734645 np0000000669 nova-compute[97951]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.40.100,3260] successful.
May 13 04:17:18.734645 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.756140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.764057 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.765978 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Attempting to attach volume 36055a9b-69dd-44bc-b37b-45142850db35 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:17:18.769432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.774803 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:   <alias name="ua-36055a9b-69dd-44bc-b37b-45142850db35"/>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:   <serial>36055a9b-69dd-44bc-b37b-45142850db35</serial>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]: </disk>
May 13 04:17:18.774803 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:17:18.798028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260]
May 13 04:17:18.798028 np0000000669 nova-compute[97951]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-99367786-ac0d-4955-a3d0-5375f71bc972, portal: 192.168.50.100,3260] successful.
May 13 04:17:18.798028 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.811898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:18.812362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:18.812479 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] <== disconnect_volume: return (328ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:18.812678 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:17:18.815472 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Deleting instance files /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_del
May 13 04:17:18.819606 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Deletion of /opt/stack/data/nova/instances/9aea12d5-7e2c-4027-8bba-51aff967d2e0_del complete
May 13 04:17:18.924631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6be8acc6-a5ec-44ec-a6c8-d8e8c9286bca req-899c22ab-821a-401a-b654-ab5e4b278799 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:18.925024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6be8acc6-a5ec-44ec-a6c8-d8e8c9286bca req-899c22ab-821a-401a-b654-ab5e4b278799 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:18.928572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6be8acc6-a5ec-44ec-a6c8-d8e8c9286bca req-899c22ab-821a-401a-b654-ab5e4b278799 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:18.930229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6be8acc6-a5ec-44ec-a6c8-d8e8c9286bca req-899c22ab-821a-401a-b654-ab5e4b278799 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:18.930229 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6be8acc6-a5ec-44ec-a6c8-d8e8c9286bca req-899c22ab-821a-401a-b654-ab5e4b278799 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Processing event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:17:18.990611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:18.996252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:19.019389 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:19.020536 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:19.332097 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Took 1.74 seconds to destroy the instance on the hypervisor.
May 13 04:17:19.333239 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:17:19.333481 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:17:19.333651 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:17:19.334102 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:19.413098 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:19.564928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:19.667192 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:17:19.667414 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645839.667093, a26ca192-6544-4d60-b566-17ee3d91bff7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:19.667601 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Started (Lifecycle Event)
May 13 04:17:19.672236 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:17:19.672825 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance spawned successfully.
May 13 04:17:19.673037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:17:19.883469 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4c0f442a-c941-4b80-88e1-c4bb1fb3783f req-1c471048-62b3-462c-b291-50fe66b48132 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-deleted-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:19.884126 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-4c0f442a-c941-4b80-88e1-c4bb1fb3783f req-1c471048-62b3-462c-b291-50fe66b48132 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Neutron deleted interface ccaadeda-1fb5-45f0-8390-231d698576c4; detaching it from the instance and deleting it from the info cache
May 13 04:17:19.884913 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4c0f442a-c941-4b80-88e1-c4bb1fb3783f req-1c471048-62b3-462c-b291-50fe66b48132 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:19.928853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:19.929291 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] Acquiring lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:19.932427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:19.932427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:19.932427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] No waiting events found dispatching network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:19.932427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2045fa4e-6d14-485c-8538-942e17ff5a32 req-f3d154bf-bc66-4654-a547-851da79e210f service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Received event network-vif-unplugged-ccaadeda-1fb5-45f0-8390-231d698576c4 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:17:20.082563 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:20.082870 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:20.083406 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:20.083636 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:20.173248 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:20.178543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:20.183139 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.183268 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.183550 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.183748 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.184156 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.184211 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:20.315560 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:20.333621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:20.333621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:20.387983 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4c0f442a-c941-4b80-88e1-c4bb1fb3783f req-1c471048-62b3-462c-b291-50fe66b48132 service nova] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Detach interface failed, port_id=ccaadeda-1fb5-45f0-8390-231d698576c4, reason: Instance 9aea12d5-7e2c-4027-8bba-51aff967d2e0 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:17:20.471546 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:20.471693 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:20.471757 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:20.471889 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:37:93:8a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:20.682953 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:17:20.683399 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645840.6830285, a26ca192-6544-4d60-b566-17ee3d91bff7 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:20.683399 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Paused (Lifecycle Event)
May 13 04:17:20.693607 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Took 8.10 seconds to spawn the instance on the hypervisor.
May 13 04:17:20.694082 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:20.818017 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Took 1.48 seconds to deallocate network for instance.
May 13 04:17:20.836069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:21.021571 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-a647d066-4b14-4f9c-a221-2a9b650ff61f req-b25299bb-f46b-4360-803a-23706e779154 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state None.
May 13 04:17:21.078849 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:21.079153 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:21.083532 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:21.083829 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:21.188488 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:21.190934 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645841.1906903, a26ca192-6544-4d60-b566-17ee3d91bff7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:21.191071 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Resumed (Lifecycle Event)
May 13 04:17:21.204582 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Took 13.52 seconds to build instance.
May 13 04:17:21.381241 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:17:21.393672 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:21.394348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:21.397127 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:17:21.397315 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Claim successful on node np0000000669
May 13 04:17:21.694447 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:21.705730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:21.707538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a5084c86-9bdb-4992-9661-90774782de3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.031s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:21.885646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:22.039797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8cb0d36d-6b56-47fb-bdb2-e7c89c9e7b66 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.596s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:22.086105 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:22.589648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:22.733540 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:22.734189 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:23.083251 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:23.083727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing instance network info cache due to event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:23.084237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:23.085636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:23.085636 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:23.236469 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:23.474587 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:23.587014 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:23.745579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.352s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:23.745930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:17:23.756943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.870s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:23.762775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.007s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:23.765163 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.174s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:23.765163 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:23.765163 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:17:23.844904 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Deleted allocations for instance 9aea12d5-7e2c-4027-8bba-51aff967d2e0
May 13 04:17:23.991854 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:24.142532 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updated VIF entry in instance network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:17:24.142754 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:24.265901 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:17:24.266072 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:17:24.266391 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:24.266671 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:24.367361 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4020376a6d94b8f88c2e952c7a198ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016554a7d54c4781a53b6ddb1f2e81e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:17:24.371367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:24.373280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:24.566737 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:24.644689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fc1e5f03-b18c-4469-97d9-42e94f607752 req-e0a56eec-abc1-4eaa-b1eb-9cdc68aca114 service nova] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:24.719214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:24.768851 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:17:24.799016 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:24.862269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-08897990-803b-4ff4-8d85-b89b8d1703f1 tempest-ServerActionsTestOtherB-1906736706 tempest-ServerActionsTestOtherB-1906736706-project-member] Lock "9aea12d5-7e2c-4027-8bba-51aff967d2e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.781s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:24.870364 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Successfully created port: e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:17:24.877139 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:17:24.916298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:24.916298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.026985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.027752 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:17:25.030565 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.131093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.131653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.239244 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.243715 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.273644 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:17:25.346921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.347250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.429924 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Successfully updated port: e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:17:25.450338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.450338 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:25.450622 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:25.480280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:25.480989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:25.490393 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:17:25.490625 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Claim successful on node np0000000669
May 13 04:17:25.500419 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-changed-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:25.500495 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Refreshing instance network info cache due to event network-changed-e65deb72-0c49-422a-92ee-b4c9e4777021. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:25.500703 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] Acquiring lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:25.500791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] Acquired lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:25.500921 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Refreshing network info cache for port e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:25.508697 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:25.509148 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13642MB free_disk=73.32769393920898GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:17:25.509394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:25.932703 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:26.004831 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:26.078369 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:26.232791 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:26.291238 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:17:26.292264 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:17:26.292514 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Creating image(s)
May 13 04:17:26.292942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:26.293096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:26.293931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:26.294619 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:26.298376 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:26.303339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:26.419229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:26.419658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:26.420101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:26.420607 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:26.423406 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:26.423718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:26.514087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:26.514587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:26.584125 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk 1073741824" returned: 0 in 0.069s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:26.585097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:26.585647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:26.685056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.097s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:26.685056 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:17:26.685056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:26.736882 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db86b7bc-baa4-4ac0-a191-3e5b875648e3 req-247303cf-1531-4906-95ec-0d3a9cfbe13c service nova] Releasing lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:26.738147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquired lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:26.738147 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:26.774573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:26.774915 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Cannot resize image /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:17:26.775231 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:17:26.775408 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Ensure instance console log exists: /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:17:26.775660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:26.775853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:26.776029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:26.908935 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:26.909204 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:27.304632 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:27.413496 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:27.516476 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:27.683250 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating instance_info_cache with network_info: [{"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:27.930109 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.449s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:27.931041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.421s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:27.934562 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:17:28.179568 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.185646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Releasing lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:28.186337 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance network_info: |[{"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:17:28.187798 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Start _get_guest_xml network_info=[{"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:28.190421 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:28.191661 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-194768262', uuid='c6db6f9c-40f7-4d97-ab8b-46efcb89223d'), owner=OwnerMeta(userid='e4020376a6d94b8f88c2e952c7a198ee', username='tempest-VolumesBackupsTest-986605255-project-member', projectid='016554a7d54c4781a53b6ddb1f2e81e2', projectname='tempest-VolumesBackupsTest-986605255'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645848.191274) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:28.192894 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:28.193609 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:28.194116 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:28.194339 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:28.195415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:28.195737 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:28.195881 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:28.196048 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:28.196097 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:28.196176 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:28.196277 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:28.196409 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:28.196560 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:28.196668 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:28.196844 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:28.196966 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:28.207920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-194768262',display_name='tempest-VolumesBackupsTest-instance-194768262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-194768262',id=29,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3PhUCJsxKrN7H4Ogrs6qXQFAjcxoU2giw6QvE8YT/pOpp+DZqiCjGrUkPFJRm3uv843mN2RQ3aIJ7lEoDqvetKQrDe2XQc5D03tdH59lt4evPmP82wCZnnR0VmO0dQFA==',key_name='tempest-keypair-395297174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-h9k5nho0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=c6db6f9c-40f7-4d97-ab8b-46efcb89223d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:28.208145 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:28.208599 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:28.209300 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'pci_devices' on Instance uuid c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:28.447476 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:17:28.448698 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:17:28.448783 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:28.451618 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:28.476218 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.542008 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b11065076cd40ffaa5099174eda4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c06d9163829483dafb7a6dcd1a3f194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:17:28.714008 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <uuid>c6db6f9c-40f7-4d97-ab8b-46efcb89223d</uuid>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <name>instance-0000001d</name>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesBackupsTest-instance-194768262</nova:name>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:28</nova:creationTime>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:user uuid="e4020376a6d94b8f88c2e952c7a198ee">tempest-VolumesBackupsTest-986605255-project-member</nova:user>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:project uuid="016554a7d54c4781a53b6ddb1f2e81e2">tempest-VolumesBackupsTest-986605255</nova:project>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         <nova:port uuid="e65deb72-0c49-422a-92ee-b4c9e4777021">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="serial">c6db6f9c-40f7-4d97-ab8b-46efcb89223d</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="uuid">c6db6f9c-40f7-4d97-ab8b-46efcb89223d</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.config"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:c8:6d:7e"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <target dev="tape65deb72-0c"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/console.log" append="off"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:28.714008 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Preparing to wait for external event network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-194768262',display_name='tempest-VolumesBackupsTest-instance-194768262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-194768262',id=29,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3PhUCJsxKrN7H4Ogrs6qXQFAjcxoU2giw6QvE8YT/pOpp+DZqiCjGrUkPFJRm3uv843mN2RQ3aIJ7lEoDqvetKQrDe2XQc5D03tdH59lt4evPmP82wCZnnR0VmO0dQFA==',key_name='tempest-keypair-395297174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-h9k5nho0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=c6db6f9c-40f7-4d97-ab8b-46efcb89223d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.717971 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:28.718695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:28.719023 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.719247 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d8bbfb8-c80d-5607-b1d0-6003f1fc51b5', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:28.722461 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.722890 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:28.726392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.728699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.728999 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape65deb72-0c, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:28.729152 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape65deb72-0c, col_values=(('qos', UUID('b73c2f76-07ff-48ee-ae5f-708773b22cd7')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:28.729310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape65deb72-0c, col_values=(('external_ids', {'iface-id': 'e65deb72-0c49-422a-92ee-b4c9e4777021', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:6d:7e', 'vm-uuid': 'c6db6f9c-40f7-4d97-ab8b-46efcb89223d'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:28.730064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.731201 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:28.737824 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:28.740963 np0000000669 nova-compute[97951]: INFO os_vif [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c')
May 13 04:17:28.956930 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:17:29.030848 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e23736e9-57ca-4381-be15-40188229ff0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:17:29.031074 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 895c0f15-772c-4b0f-a0b3-dc5469ce3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:17:29.031074 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance a26ca192-6544-4d60-b566-17ee3d91bff7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:17:29.031074 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:17:29.031172 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:17:29.031344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:17:29.031605 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:17:25 up 31 min,  2 users,  load average: 9.31, 7.09, 3.63\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_4c06d9163829483dafb7a6dcd1a3f194': '2', 'io_workload': '2', 'num_proj_94e441f4e3754f1692b7d4b86c603ca8': '1', 'num_proj_e3b639861ec44659ada64bddafc7172d': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_016554a7d54c4781a53b6ddb1f2e81e2': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:17:29.056077 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Successfully created port: a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:17:29.387175 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:29.387441 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:29.462397 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:17:29.581024 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:29.691619 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Successfully updated port: a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:17:29.748164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-changed-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:29.748164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Refreshing instance network info cache due to event network-changed-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:29.748164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] Acquiring lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:29.748164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] Acquired lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:29.748164 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Refreshing network info cache for port a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:29.890678 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:30.193706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:30.250765 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:30.261549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:30.261775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:30.261834 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No VIF found with MAC fa:16:3e:c8:6d:7e, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:30.262258 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Using config drive
May 13 04:17:30.384096 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:30.396823 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:17:30.397042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.467s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:30.397430 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:30.468180 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:17:30.468568 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:17:30.471341 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Creating image(s)
May 13 04:17:30.471341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:30.471341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:30.471341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:30.471341 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:30.473566 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:30.475646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:30.581364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:30.581364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:30.581364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:30.581364 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:30.582889 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:17:30.583402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:30.623287 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:30.675276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:30.677348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:30.740713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk 1073741824" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:30.741805 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:30.741805 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:30.774741 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:30.860606 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:30.861924 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:17:30.861924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:30.977526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:30.978173 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Cannot resize image /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:17:30.978628 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:17:30.979355 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Ensure instance console log exists: /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:17:30.979704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:30.980160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:30.980212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:31.032902 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Creating config drive at /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.config
May 13 04:17:31.036617 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhv534u1 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:31.085891 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhv534u1" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:31.126959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a714eed-8d97-4f41-b8fd-900f949e9f32 req-204ba231-0925-460f-98d7-791a110b27ec service nova] Releasing lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:31.128248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquired lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:31.128536 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:31.559199 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:31.593817 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:31.754003 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:31.768403 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:31.813145 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4167055d-ae2f-49eb-9f7e-cdf719862d43 req-c5b39ee9-3a61-4217-b2cd-b9369236ad86 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:31.813431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4167055d-ae2f-49eb-9f7e-cdf719862d43 req-c5b39ee9-3a61-4217-b2cd-b9369236ad86 service nova] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:31.813707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4167055d-ae2f-49eb-9f7e-cdf719862d43 req-c5b39ee9-3a61-4217-b2cd-b9369236ad86 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:31.815730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4167055d-ae2f-49eb-9f7e-cdf719862d43 req-c5b39ee9-3a61-4217-b2cd-b9369236ad86 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:31.815954 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4167055d-ae2f-49eb-9f7e-cdf719862d43 req-c5b39ee9-3a61-4217-b2cd-b9369236ad86 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Processing event network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:17:31.956961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:31.982690 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:32.032000 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:32.265921 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Updating instance_info_cache with network_info: [{"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:32.398268 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:32.400755 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:32.401173 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:17:32.401397 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:17:32.401868 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.68 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:32.620805 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645852.619402, c6db6f9c-40f7-4d97-ab8b-46efcb89223d => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:32.620805 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] VM Started (Lifecycle Event)
May 13 04:17:32.622363 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:17:32.625844 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:17:32.631077 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance spawned successfully.
May 13 04:17:32.635017 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:17:32.768929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Releasing lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:32.769315 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance network_info: |[{"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:17:32.771209 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Start _get_guest_xml network_info=[{"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:32.777096 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:32.778528 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1518602650', uuid='af5a54fc-ebb4-4985-9e99-ce2144cc8ee9'), owner=OwnerMeta(userid='6b11065076cd40ffaa5099174eda4db9', username='tempest-AttachVolumeNegativeTest-1451451802-project-member', projectid='4c06d9163829483dafb7a6dcd1a3f194', projectname='tempest-AttachVolumeNegativeTest-1451451802'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645852.7780964) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:32.781359 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:32.781990 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:32.784301 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:32.784577 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:32.785625 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:32.786095 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:32.786306 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:32.786447 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:32.786605 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:32.786748 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:32.786851 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:32.787041 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:32.787162 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:32.787306 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:32.788080 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:32.788270 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:32.813807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518602650',display_name='tempest-AttachVolumeNegativeTest-server-1518602650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1518602650',id=30,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbaNWvJqwz4UY7wT5PsMEbyA1rxTIk/6b11kPk1PfA0E0VCiF+tyg/fIQKTOEKquiZRknnuoLJSRQ27vrCGyQB3eCYBcwQTtEwdB5LZascShzrk6OyGTHs1nHbBgLzz/A==',key_name='tempest-keypair-497790705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-kh8dxa4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=af5a54fc-ebb4-4985-9e99-ce2144cc8ee9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:32.814059 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:32.814715 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:32.816512 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'pci_devices' on Instance uuid af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:32.949852 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0006428120000236959 future=<Future at 0x7a4648102d20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:32.951476 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:32.951476 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] Emitting event <LifecycleEvent: 1778645837.9490685, 9aea12d5-7e2c-4027-8bba-51aff967d2e0 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:32.951476 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] VM Stopped (Lifecycle Event)
May 13 04:17:33.119718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.125905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:33.128843 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:33.143864 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.143977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.144313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.144538 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.144765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.144999 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:33.320979 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <uuid>af5a54fc-ebb4-4985-9e99-ce2144cc8ee9</uuid>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <name>instance-0000001e</name>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1518602650</nova:name>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:32</nova:creationTime>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:user uuid="6b11065076cd40ffaa5099174eda4db9">tempest-AttachVolumeNegativeTest-1451451802-project-member</nova:user>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:project uuid="4c06d9163829483dafb7a6dcd1a3f194">tempest-AttachVolumeNegativeTest-1451451802</nova:project>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         <nova:port uuid="a8985c60-f211-4ff4-94f4-3f7ff0d5c14b">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="serial">af5a54fc-ebb4-4985-9e99-ce2144cc8ee9</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="uuid">af5a54fc-ebb4-4985-9e99-ce2144cc8ee9</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.config"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:e5:46:50"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <target dev="tapa8985c60-f2"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/console.log" append="off"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:33.320979 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:33.323088 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Preparing to wait for external event network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:33.323088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:33.323088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:33.323088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:33.324024 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518602650',display_name='tempest-AttachVolumeNegativeTest-server-1518602650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1518602650',id=30,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbaNWvJqwz4UY7wT5PsMEbyA1rxTIk/6b11kPk1PfA0E0VCiF+tyg/fIQKTOEKquiZRknnuoLJSRQ27vrCGyQB3eCYBcwQTtEwdB5LZascShzrk6OyGTHs1nHbBgLzz/A==',key_name='tempest-keypair-497790705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-kh8dxa4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=af5a54fc-ebb4-4985-9e99-ce2144cc8ee9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:33.324235 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:33.324836 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:33.325128 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:33.328344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.328344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:33.328430 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:33.331601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.331866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75622c5d-1ad0-55bf-99c5-db765c553314', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:33.333141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.334355 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:33.334798 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.338940 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.339159 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8985c60-f2, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:33.339620 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8985c60-f2, col_values=(('qos', UUID('f9ee8171-aa89-46d7-941c-2a363086bd8b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:33.339718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8985c60-f2, col_values=(('external_ids', {'iface-id': 'a8985c60-f211-4ff4-94f4-3f7ff0d5c14b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:46:50', 'vm-uuid': 'af5a54fc-ebb4-4985-9e99-ce2144cc8ee9'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:33.343696 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.344655 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:33.348282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:33.349194 np0000000669 nova-compute[97951]: INFO os_vif [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2')
May 13 04:17:33.460449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5a340606-465f-49f9-8ee8-a0fd7e173982 tempest-ServerRescueNegativeTestJSON-1023276944 tempest-ServerRescueNegativeTestJSON-1023276944-project-member] [instance: 9aea12d5-7e2c-4027-8bba-51aff967d2e0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:33.631105 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:17:33.632384 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645853.631171, c6db6f9c-40f7-4d97-ab8b-46efcb89223d => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:33.632648 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] VM Paused (Lifecycle Event)
May 13 04:17:33.652096 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Took 7.36 seconds to spawn the instance on the hypervisor.
May 13 04:17:33.652425 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:33.898386 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:33.898748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:33.898907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:33.899074 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:33.899181 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] No waiting events found dispatching network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:33.899293 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-f8d8ce94-6b50-413b-9ac0-d656ac88e97f req-3c33482a-7ac1-4646-ad1f-71e5d9bc27f1 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received unexpected event network-vif-plugged-e65deb72-0c49-422a-92ee-b4c9e4777021 for instance with vm_state active and task_state None.
May 13 04:17:34.135242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:34.137565 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645854.1372166, c6db6f9c-40f7-4d97-ab8b-46efcb89223d => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:34.137772 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] VM Resumed (Lifecycle Event)
May 13 04:17:34.164537 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Took 12.82 seconds to build instance.
May 13 04:17:34.583788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:34.644292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:34.648709 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:34.669898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b89d273-f34c-46b2-ae92-0bc84f16e34d tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.334s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:34.877813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:34.877997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:34.878119 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:e5:46:50, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:34.878574 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Using config drive
May 13 04:17:35.387366 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:35.429933 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-changed-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:35.429933 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Refreshing instance network info cache due to event network-changed-e65deb72-0c49-422a-92ee-b4c9e4777021. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:35.430358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] Acquiring lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:35.430358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] Acquired lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:35.430358 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Refreshing network info cache for port e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:35.642921 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Creating config drive at /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.config
May 13 04:17:35.649504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd7smrb7f {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:35.725669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd7smrb7f" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:35.936445 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:35.983903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:36.246578 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:36.278500 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:36.395227 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:36.442083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:36.517787 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:36.648114 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f378dac3-1cc4-4403-b1de-d82a69dbabfd req-97a3ba88-620d-4082-9ef6-fb0272f5f098 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:36.648499 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f378dac3-1cc4-4403-b1de-d82a69dbabfd req-97a3ba88-620d-4082-9ef6-fb0272f5f098 service nova] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:36.650499 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f378dac3-1cc4-4403-b1de-d82a69dbabfd req-97a3ba88-620d-4082-9ef6-fb0272f5f098 service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:36.650825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f378dac3-1cc4-4403-b1de-d82a69dbabfd req-97a3ba88-620d-4082-9ef6-fb0272f5f098 service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:36.651341 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f378dac3-1cc4-4403-b1de-d82a69dbabfd req-97a3ba88-620d-4082-9ef6-fb0272f5f098 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Processing event network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:17:36.758588 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updated VIF entry in instance network info cache for port e65deb72-0c49-422a-92ee-b4c9e4777021. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:17:36.758588 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating instance_info_cache with network_info: [{"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:37.261411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbce4a4d-db94-45a5-bda8-17f9692d9242 req-5a06be54-84b4-41b6-9b8d-3de70ee5566b service nova] Releasing lock "refresh_cache-c6db6f9c-40f7-4d97-ab8b-46efcb89223d" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:37.353956 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645857.3534572, af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:37.354176 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] VM Started (Lifecycle Event)
May 13 04:17:37.356026 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:17:37.359864 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:17:37.365671 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance spawned successfully.
May 13 04:17:37.366459 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:17:37.857887 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:37.860678 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:37.880035 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:37.880207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:37.880575 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:37.880819 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:37.881399 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:37.881840 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:17:38.342593 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:38.363311 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:17:38.363668 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645858.3634415, af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:38.363813 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] VM Paused (Lifecycle Event)
May 13 04:17:38.387719 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Took 7.92 seconds to spawn the instance on the hypervisor.
May 13 04:17:38.387907 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:38.734288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:38.734527 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:38.734767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:38.735039 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:38.735132 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] No waiting events found dispatching network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:38.735271 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fa71a8e3-e0a2-426a-81ab-6e8dd736263f req-d7273f99-0e61-4dc7-ad7f-f7a21eb505fe service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received unexpected event network-vif-plugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b for instance with vm_state active and task_state None.
May 13 04:17:38.871302 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:38.873652 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645858.8734019, af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:38.873786 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] VM Resumed (Lifecycle Event)
May 13 04:17:38.903850 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Took 13.52 seconds to build instance.
May 13 04:17:39.379626 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:39.381521 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:39.407677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8066c734-ecf5-474c-ab40-cf227a312614 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:39.591607 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:40.094128 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:17:41.155257 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-changed-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:41.155257 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Refreshing instance network info cache due to event network-changed-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:41.155795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] Acquiring lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:41.155795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] Acquired lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:41.155795 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Refreshing network info cache for port a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:41.179465 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:41.179465 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:41.658051 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:41.680575 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:17:42.136876 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:42.235365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:42.235365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:42.238516 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:17:42.238809 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Claim successful on node np0000000669
May 13 04:17:42.297006 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Updated VIF entry in instance network info cache for port a8985c60-f211-4ff4-94f4-3f7ff0d5c14b. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:17:42.297272 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Updating instance_info_cache with network_info: [{"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:42.799202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1ab7698b-12ea-45c3-b79a-efdaa148da8f req-67103ea0-e83e-40ef-b25a-d07e138b1bc2 service nova] Releasing lock "refresh_cache-af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:43.346592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:43.642430 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:17:43.642732 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:17:44.145997 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:17:44.594156 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:44.654744 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.420s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:44.655044 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:17:45.166991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:17:45.167234 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:17:45.167730 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:45.167932 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:45.267277 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d575550f71492580f700f334bc84b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf2cd35b50144e09a9d2fa69360c9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:17:45.668293 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:17:45.861046 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Successfully created port: c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:17:46.180522 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:17:46.535072 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Successfully updated port: c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:17:46.614991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-changed-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:46.615050 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Refreshing instance network info cache due to event network-changed-c5028e97-a0d6-4813-a661-dc6aec89dfbc. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:46.615616 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] Acquiring lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:46.615718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] Acquired lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:46.615836 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Refreshing network info cache for port c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:46.685212 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Booting with volume b5ff2a40-effd-4a6f-837c-4809bb8c128c at /dev/vda
May 13 04:17:46.746145 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:46.758412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:17:46.780466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:46.825442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:17:46.825769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:17:46.837743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:17:46.839328 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:febd:7653', 'fe80::c0fb:9ff:fee9:b80', 'fe80::fc16:3eff:fea1:ebfc', 'fe80::3888:77ff:fecf:8e8a', 'fe80::fc16:3eff:fec8:6d7e', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fee5:4650'] 
May 13 04:17:46.839519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:17:46.839663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:17:46.839956 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:46.840211 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating existing volume attachment record: e6f27842-1b5a-4358-a8ad-26f2aadb6147 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:17:47.037694 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:47.121131 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:47.207273 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:47.369993 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:47.873894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fbfeef13-1714-4b16-8e6f-21f918f7d237 req-b4d8ac02-acba-4b05-bcaf-b5905f8293a9 service nova] Releasing lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:47.874464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquired lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:47.874680 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:48.349601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:48.442796 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:17:48.612411 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:48.779146 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating instance_info_cache with network_info: [{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:48.966366 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:17:48.970346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:17:48.970346 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating image(s)
May 13 04:17:48.971918 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:17:48.971918 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Ensure instance console log exists: /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:17:48.971918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:48.971918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:48.971918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:49.281726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Releasing lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:49.281963 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance network_info: |[{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:17:49.282547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start _get_guest_xml network_info=[{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b6e65a61-0ae4-402c-9138-cef6ac3ae614', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'serial': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c'}, 'disk_bus': 'virtio', 'attachment_id': 'e6f27842-1b5a-4358-a8ad-26f2aadb6147', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:17:49.287229 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:17:49.287229 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-373649676', uuid='b6e65a61-0ae4-402c-9138-cef6ac3ae614'), owner=OwnerMeta(userid='60d575550f71492580f700f334bc84b0', username='tempest-ServerActionsV293TestJSON-1586826136-project-member', projectid='cbf2cd35b50144e09a9d2fa69360c9f6', projectname='tempest-ServerActionsV293TestJSON-1586826136'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645869.2865734) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:17:49.290499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:17:49.290965 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:17:49.292155 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:17:49.292522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:17:49.293575 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:17:49.293962 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:17:49.294231 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:17:49.294449 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:17:49.294700 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:17:49.294894 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:17:49.295089 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:17:49.295376 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:17:49.295584 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:17:49.295834 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:17:49.296343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:17:49.296343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:17:49.308416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:17:49.308416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:17:49.308416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:49.309422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:49.309422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:17:49.323213 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:49.323724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:17:49.324316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:49.324576 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:49.325009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:17:49.325232 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:49.328017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:49.328184 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:49.328299 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Shelving
May 13 04:17:49.342052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:49.342052 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:49.350888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:17:49.350888 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:49.356374 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c] added
May 13 04:17:49.356374 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:49.356374 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:49.356374 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:49.356374 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:49.356374 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:49.356374 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:49.356628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:49.356920 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:49.357147 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:49.365784 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c] added
May 13 04:17:49.365784 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:17:49.365784 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:49.365784 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:49.365784 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:17:49.365784 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:17:49.365784 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:49.366596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:17:49.366596 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:17:49.366596 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:17:49.598139 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.357652 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:17:50.360088 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.365306 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.372417 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:50.381786 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:50.381786 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.392570 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:17:50.396881 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:17:50.396881 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.402064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.402064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.413389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.420806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.420806 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.420806 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:50.421205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.421205 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.421205 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:50.427867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:50.428163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.428163 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.428163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:50.430412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.430412 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.430412 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:50.457984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260]
May 13 04:17:50.457984 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260] successful.
May 13 04:17:50.457984 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.469064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260]
May 13 04:17:50.469064 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260] successful.
May 13 04:17:50.469064 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.478298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.487697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:17:50.497059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.497059 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.497059 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.497059 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.497059 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.498556 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:50.498556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:50.499881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] HCTL ('7', '-', '-', 0) found on session 64 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:50.500389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:50.506598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.506598 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.506598 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.506598 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.506598 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:17:50.506827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.506827 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:17:50.506827 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.506827 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:17:50.506827 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:17:50.507023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:50.507129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:17:50.507679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] HCTL ('8', '-', '-', 0) found on session 65 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:17:50.507824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:17:50.528938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching for a device in session 64 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:50.528938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:50.533677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching for a device in session 65 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:17:50.533861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:17:50.665803 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:50.666486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:50.666557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:50.666711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:50.666914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:50.667088 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-a8d7d0e5-0e59-43e2-9551-afbe4edef3d2 req-481f4f84-f37e-4aed-aa9b-04ee76aa9b25 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received unexpected event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with vm_state active and task_state shelving.
May 13 04:17:50.680412 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999650251000048 future=<Future at 0x7a464826bfe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:50.682688 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997349289000113 future=<Future at 0x7a464826bfe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:50.682973 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997044596000023 future=<Future at 0x7a464826bfe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:17:50.683791 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance destroyed successfully.
May 13 04:17:50.684297 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'numa_topology' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:51.296919 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Beginning cold snapshot process
May 13 04:17:51.324803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:17:52.347669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Found WWN 3300000008864b09c for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:17:52.348198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:17:52.348289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000008864b09c', 'path': '/dev/dm-0', 'multipath_id': '3300000008864b09c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:17:52.348416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008864b09c', 'path': '/dev/dm-0', 'multipath_id': '3300000008864b09c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:17:52.741982 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:52.742653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:52.742653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:52.742812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:52.743029 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:17:52.743079 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-32bd0038-7861-45ba-b640-369da69d0155 req-4163af6d-8123-4552-bce4-e67f5792b138 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received unexpected event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with vm_state active and task_state shelving_image_pending_upload.
May 13 04:17:52.813853 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:17:52.813853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk /opt/stack/data/nova/instances/snapshots/tmp10gfk0bm/9e33115d4c844e87b44b906ce2018cbe {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:52.857349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-373649676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:17:52.857349 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:52.857662 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:52.861358 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lazy-loading 'pci_devices' on Instance uuid b6e65a61-0ae4-402c-9138-cef6ac3ae614 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:52.984907 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.138313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk /opt/stack/data/nova/instances/snapshots/tmp10gfk0bm/9e33115d4c844e87b44b906ce2018cbe" returned: 0 in 0.324s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:53.138674 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Snapshot extracted, beginning image upload
May 13 04:17:53.350776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.364843 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] End _get_guest_xml xml=<domain type="qemu">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <uuid>b6e65a61-0ae4-402c-9138-cef6ac3ae614</uuid>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <name>instance-0000001f</name>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsV293TestJSON-server-373649676</nova:name>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:17:49</nova:creationTime>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:user uuid="60d575550f71492580f700f334bc84b0">tempest-ServerActionsV293TestJSON-1586826136-project-member</nova:user>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:project uuid="cbf2cd35b50144e09a9d2fa69360c9f6">tempest-ServerActionsV293TestJSON-1586826136</nova:project>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         <nova:port uuid="c5028e97-a0d6-4813-a661-dc6aec89dfbc">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <system>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="serial">b6e65a61-0ae4-402c-9138-cef6ac3ae614</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="uuid">b6e65a61-0ae4-402c-9138-cef6ac3ae614</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </system>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <os>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </os>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <features>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </features>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   <devices>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <alias name="ua-b5ff2a40-effd-4a6f-837c-4809bb8c128c"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <serial>b5ff2a40-effd-4a6f-837c-4809bb8c128c</serial>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </disk>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:10:60:b5"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <target dev="tapc5028e97-a0"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </interface>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/console.log" append="off"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </serial>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <video>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </video>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </rng>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:   </devices>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]: </domain>
May 13 04:17:53.364843 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Preparing to wait for external event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-373649676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:17:53.367452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:53.370562 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:53.371034 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:17:53.371404 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.371651 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:53.372118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:17:53.376574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.377186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e208754-86b9-56d6-b715-37b8263a3abd', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:53.379346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.379612 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:53.385952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.389427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.389573 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5028e97-a0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:53.390241 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5028e97-a0, col_values=(('qos', UUID('dc85b1a7-344e-485e-9675-d817deb45d24')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:53.390544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5028e97-a0, col_values=(('external_ids', {'iface-id': 'c5028e97-a0d6-4813-a661-dc6aec89dfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:60:b5', 'vm-uuid': 'b6e65a61-0ae4-402c-9138-cef6ac3ae614'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:53.394136 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.397651 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:53.410447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:53.410958 np0000000669 nova-compute[97951]: INFO os_vif [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0')
May 13 04:17:54.599022 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:54.934286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:54.934442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:17:54.934608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No VIF found with MAC fa:16:3e:10:60:b5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:17:54.935030 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Using config drive
May 13 04:17:55.440481 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:55.620922 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating config drive at /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config
May 13 04:17:55.629130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpin_up12e {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:17:55.694331 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpin_up12e" returned: 0 in 0.065s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:17:56.079859 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.139001 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Snapshot image upload complete
May 13 04:17:56.139554 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:56.178100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.218305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.317376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.538250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.546790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.551438 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.581303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.589934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:56.653130 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Shelve offloading
May 13 04:17:57.058430 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645877.0580661, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:57.059691 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Started (Lifecycle Event)
May 13 04:17:57.163653 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance destroyed successfully.
May 13 04:17:57.164202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:57.165596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:57.165778 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:57.165934 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:17:57.561498 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:57.563614 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645877.5633793, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:17:57.563783 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Paused (Lifecycle Event)
May 13 04:17:57.668080 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:58.068271 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:58.071187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:17:58.104116 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:58.264103 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:17:58.394885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:58.579007 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:17:58.615943 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:58.768302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:17:58.768302 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:58.768302 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:17:59.297845 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance destroyed successfully.
May 13 04:17:59.299062 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'resources' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:17:59.349989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.374641 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:17:59.374807 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing instance network info cache due to event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:17:59.381185 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:17:59.382121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:17:59.382292 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:17:59.609756 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.661211 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:17:59.801718 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:17:59.802347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYmyFtnd1eLID1EsfTwvaras4CcC8UsQP9RdC13+DKK43Y/vzmRVw1KFJ0lappqbALhb4+6211tufaRF9DIVglBJNbtdud5OUZ21p/5r5kiqDkAxRjH/CBV19O8hp6hhA==',key_name='tempest-keypair-844275117',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:08Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:17:56.139133',shelved_host='np0000000669',shelved_image_id='8755a7bf-a16b-4193-9239-f4b4b4e2c08e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:17:59.802533 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:17:59.803342 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:17:59.803463 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:17:59.805352 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.805579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c562a0-eb, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:59.808873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.811607 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:59.812486 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.812697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d30117-f6c9-47e3-90ca-6c53abfcd6a7) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:17:59.813162 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:17:59.815335 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:17:59.820911 np0000000669 nova-compute[97951]: INFO os_vif [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb')
May 13 04:17:59.822343 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Deleting instance files /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508_del
May 13 04:17:59.832702 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Deletion of /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508_del complete
May 13 04:17:59.887346 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:00.170016 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] instance snapshotting
May 13 04:18:00.296965 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Beginning live snapshot process
May 13 04:18:00.416389 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Deleted allocations for instance 895c0f15-772c-4b0f-a0b3-dc5469ce3508
May 13 04:18:00.486647 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:00.758138 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updated VIF entry in instance network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:00.758394 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape8c562a0-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:00.925896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:00.926720 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:01.116691 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:01.261030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-78d7fd0c-0d45-4b20-bede-ff4345b204c4 req-303cda85-a5f2-4336-ba4a-0cb5d09861bc service nova] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:01.263729 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:01.300519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:01.300837 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:01.450557 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c68ef58c-2685-4b5e-b8a2-01fc5e121164 req-48cc3976-6abf-48bc-87ae-521b0ec5fb8a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:01.450741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c68ef58c-2685-4b5e-b8a2-01fc5e121164 req-48cc3976-6abf-48bc-87ae-521b0ec5fb8a service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:01.450945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c68ef58c-2685-4b5e-b8a2-01fc5e121164 req-48cc3976-6abf-48bc-87ae-521b0ec5fb8a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:01.451753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c68ef58c-2685-4b5e-b8a2-01fc5e121164 req-48cc3976-6abf-48bc-87ae-521b0ec5fb8a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:01.451753 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c68ef58c-2685-4b5e-b8a2-01fc5e121164 req-48cc3976-6abf-48bc-87ae-521b0ec5fb8a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Processing event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:01.455813 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:01.464217 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:01.466783 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645881.466441, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:01.466932 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Resumed (Lifecycle Event)
May 13 04:18:01.468890 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance spawned successfully.
May 13 04:18:01.472241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:18:01.807975 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:01.824351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:01.931015 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json -f qcow2" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:01.931881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:01.973567 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:01.985275 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:01.991723 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:01.991882 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:01.992713 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:01.992713 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:01.992801 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:01.993193 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:02.061950 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:02.063528 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:02.069441 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:02.070162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:02.187610 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:02.188222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5.delta 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:02.257476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5.delta 1073741824" returned: 0 in 0.069s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:02.257968 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 04:18:02.322508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.396s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:02.491356 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:18:02.500149 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Took 13.53 seconds to spawn the instance on the hypervisor.
May 13 04:18:02.500398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:02.580527 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] COPY block job progress, current cursor: 0 final cursor: 77135872 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:18:02.837570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-04c885d2-c7d8-43df-b9f5-ddeeb0b3d816 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:03.019289 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Took 20.83 seconds to build instance.
May 13 04:18:03.082630 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] COPY block job progress, current cursor: 77135872 final cursor: 77135872 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:18:03.084946 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 04:18:03.138881 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:18:03.139225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5.delta /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:03.410712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5.delta /opt/stack/data/nova/instances/snapshots/tmpv29uk56s/86ee1af9d45246598d6debabbb7c74d5" returned: 0 in 0.271s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:03.416047 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Snapshot extracted, beginning image upload
May 13 04:18:03.521491 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.342s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:03.610153 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:03.610500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:03.610625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:03.612404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:03.612404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:03.612404 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-47a7737f-2dfb-496f-b8be-7f33e359dda6 req-b7ca93bb-f443-4a8a-8168-b12ac14de874 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received unexpected event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with vm_state active and task_state None.
May 13 04:18:03.974398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:03.974568 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:03.974715 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Unshelving
May 13 04:18:04.467859 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:04.612404 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:04.813659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:04.844779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:04.845125 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:05.049894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:05.049894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:05.052024 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_requests' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:05.347783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:18:05.558360 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'numa_topology' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:05.682742 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00042038299989144434 future=<Future at 0x7a464826bfe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:05.682742 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645870.6799357, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:05.682742 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:05.682742 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Stopped (Lifecycle Event)
May 13 04:18:05.701061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-changed-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:05.701233 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Refreshing instance network info cache due to event network-changed-c5028e97-a0d6-4813-a661-dc6aec89dfbc. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:05.701579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] Acquiring lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:05.703035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] Acquired lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:05.703035 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Refreshing network info cache for port c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:05.914841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:06.061747 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:18:06.061857 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Claim successful on node np0000000669
May 13 04:18:06.186636 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:06.207828 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:06.303426 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:06.719624 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:06.823768 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Snapshot image upload complete
May 13 04:18:06.824117 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-248b1fb0-797b-4cbf-855b-f5593a8eb6bc tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Took 6.65 seconds to snapshot the instance on the hypervisor.
May 13 04:18:06.932387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updated VIF entry in instance network info cache for port c5028e97-a0d6-4813-a661-dc6aec89dfbc. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:06.932387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating instance_info_cache with network_info: [{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:07.435393 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-031b24a6-3ba5-4784-b6dd-ede3206736a6 req-d56b0573-c698-4ff1-b6ed-ffa0b3c84d31 service nova] Releasing lock "refresh_cache-b6e65a61-0ae4-402c-9138-cef6ac3ae614" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:07.643391 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:07.643629 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:07.990350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:07.990350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:08.147787 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:08.311365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:08.311817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:08.492779 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:18:08.657247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.607s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:08.657736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.743s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:08.658123 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:08.663352 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:18:08.663352 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Claim successful on node np0000000669
May 13 04:18:08.731691 np0000000669 nova-compute[97951]: INFO nova.network.neutron [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating port e8c562a0-eb26-4e3a-a170-8f1da7a57976 with attributes {'binding:host_id': 'np0000000669', 'device_owner': 'compute:nova'}
May 13 04:18:08.815590 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'flavor' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:09.068186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:09.241621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:09.242304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:09.242491 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:09.290543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:09.290735 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing instance network info cache due to event network-changed-e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:09.290946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] Acquiring lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:09.612222 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:09.746070 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:09.815123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:09.821081 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:10.160821 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:10.209017 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:10.209269 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:10.316358 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:10.712479 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:10.818409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:10.819393 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:10.819786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] Acquired lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:10.819965 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Refreshing network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:10.821503 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating image(s)
May 13 04:18:10.821753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:10.821909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:10.823424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:10.823424 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'trusted_certs' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:10.942537 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:10.942734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:10.942918 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attaching volume 203fccaa-ad18-4bee-8e22-bbdd75ba3d2a to /dev/vdb
May 13 04:18:10.997037 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:11.011763 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:18:11.037994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:11.093762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:18:11.096969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:18:11.108485 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:18:11.111657 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fea1:ebfc', 'fe80::3888:77ff:fecf:8e8a', 'fe80::fc16:3eff:fec8:6d7e', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fee5:4650', 'fe80::fc16:3eff:fe10:60b5', 'fe80::10fa:20ff:fe53:97e4'] 
May 13 04:18:11.111866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:18:11.111866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:18:11.112101 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:11.112378 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating existing volume attachment record: dd6c80c2-b333-4138-919f-66bff4704d1b {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:18:11.222233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.565s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:11.223201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.154s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:11.223496 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:18:11.231031 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:18:11.231183 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Claim successful on node np0000000669
May 13 04:18:11.325015 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:11.326946 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:11.327656 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:11.328237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:11.393924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:11.394358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:11.682346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:18:11.682346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:11.682346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:11.723279 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:11.734401 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:18:11.734401 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:18:11.734401 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:11.734401 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:11.816670 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd7d5914f54b4045b7ba7edb97613086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2e949cc9fb441d4af79255215405cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:18:11.899167 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:11.902905 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updated VIF entry in instance network info cache for port e8c562a0-eb26-4e3a-a170-8f1da7a57976. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:11.904739 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:12.130933 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.133337 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.133694 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.226416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.part --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.226924 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] 8755a7bf-a16b-4193-9239-f4b4b4e2c08e was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:18:12.229977 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:18:12.229977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.part /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.248621 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:18:12.390984 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Successfully created port: 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:18:12.402073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.part /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.converted" returned: 0 in 0.174s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.404478 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Ignoring supplied device name: /dev/vdb
May 13 04:18:12.406101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-367cf37e-62e8-479f-9989-c76f1ec3c14d req-6d649816-088c-43f9-b83e-cf98658e07cf service nova] Releasing lock "refresh_cache-895c0f15-772c-4b0f-a0b3-dc5469ce3508" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:12.417547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.506160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.506739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.178s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:12.507140 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.512438 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.512438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.598894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.599284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:12.599796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:12.600279 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.602799 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:12.603098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.686065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.686429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4,backing_fmt=raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.754194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4,backing_fmt=raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk 1073741824" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.754609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:12.755001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:12.774173 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:18:12.781156 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:12.782269 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:12.844273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be8f0d1acaa77b4e6c3734fac2ee3ac9e645f9d4 --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:12.844633 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'migration_context' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:12.888309 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Successfully updated port: 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:18:12.907497 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:12.951094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-changed-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:12.951461 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Refreshing instance network info cache due to event network-changed-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:12.951680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] Acquiring lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:12.951828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] Acquired lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:12.952008 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Refreshing network info cache for port 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:13.254535 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.574s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:13.254966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:18:13.266556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:13.267343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:13.267923 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:13.268114 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:18:13.268830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:13.269364 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:18:13.278236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:18:13.278236 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:13.284777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:18:13.284777 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:13.286166 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:13.295282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a] added
May 13 04:18:13.295282 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:18:13.295282 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:13.295282 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:13.295282 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:13.295282 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:13.295282 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:13.295911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:18:13.296117 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:18:13.296257 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:18:13.296833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a] added
May 13 04:18:13.296833 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:18:13.296833 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:13.296833 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:13.296833 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:13.296833 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:13.296833 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:13.301059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:18:13.301395 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:18:13.301600 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:18:13.346479 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:13.347102 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Rebasing disk image.
May 13 04:18:13.347362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:13.391736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:13.442017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:13.442017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d -F raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:13.456847 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:13.581564 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:13.787152 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:13.788351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:18:13.789974 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:13.790291 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Creating image(s)
May 13 04:18:13.791080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:13.791382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:13.792218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:13.793009 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:13.799205 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:13.800858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:13.833491 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.610s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:13.834652 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:18:13.922312 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:13.922750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:13.923334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:13.923796 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:13.930312 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:13.931128 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:14.038173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:14.038531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:14.039920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:14.057407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.016s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:14.058693 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Attaching volume b1e4da0a-464f-4ec4-a803-994734da7f2a to /dev/vdb
May 13 04:18:14.103268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk 1073741824" returned: 0 in 0.065s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:14.104947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:14.105335 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:14.135216 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:14.149676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:18:14.175874 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:14.222101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:14.222662 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:18:14.222958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:14.233603 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:18:14.233936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:18:14.242585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:18:14.245702 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe37:938a', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fea1:ebfc', 'fe80::3888:77ff:fecf:8e8a', 'fe80::fc16:3eff:fec8:6d7e', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fee5:4650', 'fe80::fc16:3eff:fe10:60b5', 'fe80::10fa:20ff:fe53:97e4'] 
May 13 04:18:14.246023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:18:14.246245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:18:14.246653 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:14.247751 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating existing volume attachment record: d0c1e640-4f3f-41a1-814e-1668981da179 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:18:14.292727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d79e0b4d-9158-4e6a-836e-1bace997264a req-6a9318ea-65bf-4a75-8f68-00cd04b1e930 service nova] Releasing lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:14.293356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquired lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:14.293574 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:14.297665 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:18:14.302452 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:14.312774 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:14.312774 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.316309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:14.317238 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Cannot resize image /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:18:14.317654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:14.317847 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Ensure instance console log exists: /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:14.318172 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:14.318467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:14.318651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:14.320134 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:14.320134 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.328570 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.334235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.344002 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:18:14.344411 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:18:14.344914 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:14.345554 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.352000 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:14.352712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352712 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.352712 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352712 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.352712 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.352712 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:14.353030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.353030 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.353030 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.353030 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.353030 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.353030 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:14.366899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d -F raw /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk" returned: 0 in 0.925s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:14.367233 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:14.367476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Ensure instance console log exists: /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:14.367748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:14.368030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:14.368156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:14.369695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start _get_guest_xml network_info=[{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='04a2cb032db777596117c4886becc0b9',container_format='bare',created_at=2026-05-13T04:17:49Z,direct_url=<?>,disk_format='qcow2',id=8755a7bf-a16b-4193-9239-f4b4b4e2c08e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-517050181-shelved',owner='94e441f4e3754f1692b7d4b86c603ca8',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-13T04:17:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:14.373147 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:14.374407 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-517050181', uuid='895c0f15-772c-4b0f-a0b3-dc5469ce3508'), owner=OwnerMeta(userid='7cf2542ae398407abdb47a235f3c8505', username='tempest-AttachVolumeShelveTestJSON-173127407-project-member', projectid='94e441f4e3754f1692b7d4b86c603ca8', projectname='tempest-AttachVolumeShelveTestJSON-173127407'), image=ImageMeta(id='8755a7bf-a16b-4193-9239-f4b4b4e2c08e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645894.3740551) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:14.375639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:14.375639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:14.376491 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:14.376676 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:14.377833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:14.378173 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='04a2cb032db777596117c4886becc0b9',container_format='bare',created_at=2026-05-13T04:17:49Z,direct_url=<?>,disk_format='qcow2',id=8755a7bf-a16b-4193-9239-f4b4b4e2c08e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-517050181-shelved',owner='94e441f4e3754f1692b7d4b86c603ca8',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-13T04:17:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:14.380520 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:14.381029 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:14.381220 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:14.381646 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:14.381646 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:14.381743 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:14.381919 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:14.382011 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:14.382113 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:14.382451 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:14.382672 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'vcpu_model' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:14.410207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.50.100,3260]
May 13 04:18:14.410207 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.50.100,3260] successful.
May 13 04:18:14.410207 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.426094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.434487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.40.100,3260]
May 13 04:18:14.434487 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.40.100,3260] successful.
May 13 04:18:14.434487 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.446406 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:14.446406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:14.448543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] HCTL ('12', '-', '-', 0) found on session 68 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:14.448543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:14.449350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:14.466237 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28c963711e90463b9d488c9e42c2fec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f90c5bb86747ebb4d155c53086057f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:18:14.474075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching for a device in session 68 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:14.474075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:14.484081 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:14.484081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:14.486268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] HCTL ('13', '-', '-', 0) found on session 69 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:14.486268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:14.511837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching for a device in session 69 and hctl ['13', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:14.617307 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:14.817046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:14.827649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:18:14.828096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:14.828242 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:14.846657 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:18:14.887539 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:14.901139 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='8755a7bf-a16b-4193-9239-f4b4b4e2c08e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-844275117',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:08Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:17:56.139133',shelved_host='np0000000669',shelved_image_id='8755a7bf-a16b-4193-9239-f4b4b4e2c08e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:14.901299 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:14.902258 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:14.902463 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'pci_devices' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:14.907921 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:15.043773 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Successfully created port: 7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:18:15.185045 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:15.325486 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating instance_info_cache with network_info: [{"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:15.360023 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:18:15.405285 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:15.406549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <uuid>895c0f15-772c-4b0f-a0b3-dc5469ce3508</uuid>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <name>instance-0000001b</name>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-517050181</nova:name>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:14</nova:creationTime>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:user uuid="7cf2542ae398407abdb47a235f3c8505">tempest-AttachVolumeShelveTestJSON-173127407-project-member</nova:user>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:project uuid="94e441f4e3754f1692b7d4b86c603ca8">tempest-AttachVolumeShelveTestJSON-173127407</nova:project>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         <nova:port uuid="e8c562a0-eb26-4e3a-a170-8f1da7a57976">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="serial">895c0f15-772c-4b0f-a0b3-dc5469ce3508</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="uuid">895c0f15-772c-4b0f-a0b3-dc5469ce3508</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:bd:76:53"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <target dev="tape8c562a0-eb"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/console.log" append="off"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:15.406549 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Preparing to wait for external event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='8755a7bf-a16b-4193-9239-f4b4b4e2c08e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-844275117',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:08Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member',shelved_at='2026-05-13T04:17:56.139133',shelved_host='np0000000669',shelved_image_id='8755a7bf-a16b-4193-9239-f4b4b4e2c08e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:15.409384 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:18:15.409938 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.410166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:15.410414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:18:15.411259 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.411437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3478435e-1e97-5498-bed9-41afb392d5d7', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:15.413972 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.414554 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:15.416472 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.416611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c562a0-eb, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:15.416879 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c562a0-eb, col_values=(('qos', UUID('88b1cd13-5f96-4c29-9a9a-2bdb8e56f9fd')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:15.417054 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c562a0-eb, col_values=(('external_ids', {'iface-id': 'e8c562a0-eb26-4e3a-a170-8f1da7a57976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:76:53', 'vm-uuid': '895c0f15-772c-4b0f-a0b3-dc5469ce3508'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:15.417799 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.420303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:15.426272 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:15.429813 np0000000669 nova-compute[97951]: INFO os_vif [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb')
May 13 04:18:15.509133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching for a device in session 69 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:15.509342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:15.602380 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Successfully updated port: 7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:18:15.665508 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-changed-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:15.665631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Refreshing instance network info cache due to event network-changed-7cfebe86-b441-414f-9602-5abbe6b27b1e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:15.665769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] Acquiring lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:15.665859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] Acquired lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:15.666223 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Refreshing network info cache for port 7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:15.827650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Releasing lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:15.827786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance network_info: |[{"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:18:15.830914 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Start _get_guest_xml network_info=[{"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:15.837858 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:15.839102 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247', uuid='2c3c381e-5a15-4198-afb9-388efefee7bf'), owner=OwnerMeta(userid='fd7d5914f54b4045b7ba7edb97613086', username='tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member', projectid='e2e949cc9fb441d4af79255215405cc3', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-327147590'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645895.838739) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:15.840961 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:15.841304 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:15.845043 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:15.845242 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:15.846111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:15.846422 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:15.846647 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:15.846647 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:15.846805 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:15.846935 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:15.847192 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:15.847394 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:15.847505 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:15.847628 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:15.847719 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:15.847879 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:15.862897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachscenariooldversion-server-8566042',id=32,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX9VOAeMsUrS7RTXQkdLQpFtDYPQYrtoYjYt9xH8nmVjfrnqPX+/tGdEn2F4c7nyP6TfIjGSNHr8Rh3oO5fTE+eOsB/38iOGLrdXLcnztrVr96vgvCiJpUdKqkssjyx+w==',key_name='tempest-keypair-1992566784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e949cc9fb441d4af79255215405cc3',ramdisk_id='',reservation_id='r-5lovhedg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd7d5914f54b4045b7ba7edb97613086',uuid=2c3c381e-5a15-4198-afb9-388efefee7bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:15.863135 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converting VIF {"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:15.863541 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:15.864036 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:16.108644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:16.176838 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:16.264547 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:16.286713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Found WWN 330000000dab73fc6 for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:18:16.287410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:16.287617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] <== connect_volume: return (4606ms) {'type': 'block', 'scsi_wwn': '330000000dab73fc6', 'path': '/dev/dm-4', 'multipath_id': '330000000dab73fc6'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:16.287809 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dab73fc6', 'path': '/dev/dm-4', 'multipath_id': '330000000dab73fc6'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:18:16.288845 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.460s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:16.289579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:18:16.292514 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'flavor' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:16.304560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:16.305571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:16.306384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:16.306816 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:18:16.307419 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:16.308350 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:18:16.325496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:18:16.325496 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:16.334525 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:18:16.334525 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a] added
May 13 04:18:16.341838 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:16.341838 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:18:16.341838 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:18:16.347774 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a] added
May 13 04:18:16.347774 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:18:16.347774 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:16.347774 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:16.347774 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:18:16.347774 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:18:16.347774 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:16.348174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:18:16.348437 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:18:16.348660 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:18:16.366948 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <uuid>2c3c381e-5a15-4198-afb9-388efefee7bf</uuid>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <name>instance-00000020</name>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247</nova:name>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:15</nova:creationTime>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:user uuid="fd7d5914f54b4045b7ba7edb97613086">tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member</nova:user>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:project uuid="e2e949cc9fb441d4af79255215405cc3">tempest-TestServerVolumeAttachScenarioOldVersion-327147590</nova:project>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         <nova:port uuid="161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="serial">2c3c381e-5a15-4198-afb9-388efefee7bf</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="uuid">2c3c381e-5a15-4198-afb9-388efefee7bf</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.config"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d8:8f:a1"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <target dev="tap161fcf3d-df"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/console.log" append="off"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:16.366948 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Preparing to wait for external event network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachscenariooldversion-server-8566042',id=32,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX9VOAeMsUrS7RTXQkdLQpFtDYPQYrtoYjYt9xH8nmVjfrnqPX+/tGdEn2F4c7nyP6TfIjGSNHr8Rh3oO5fTE+eOsB/38iOGLrdXLcnztrVr96vgvCiJpUdKqkssjyx+w==',key_name='tempest-keypair-1992566784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e949cc9fb441d4af79255215405cc3',ramdisk_id='',reservation_id='r-5lovhedg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd7d5914f54b4045b7ba7edb97613086',uuid=2c3c381e-5a15-4198-afb9-388efefee7bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:18:16.368702 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converting VIF {"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:16.369683 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:16.369683 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:18:16.370028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.370229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:16.370411 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:18:16.371859 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:18:16.373593 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:16.373804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.374059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd453a29d-df17-56ac-84ad-15346600ee70', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:16.374625 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Creating image(s)
May 13 04:18:16.375131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:16.375898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:16.376406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:16.377492 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:16.379575 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.380274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:16.381967 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:16.383257 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.387279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:16.399795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.400650 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap161fcf3d-df, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:16.401710 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap161fcf3d-df, col_values=(('qos', UUID('d79818f4-b598-4265-9edc-3f2b6a0531e3')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:16.402150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap161fcf3d-df, col_values=(('external_ids', {'iface-id': '161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8f:a1', 'vm-uuid': '2c3c381e-5a15-4198-afb9-388efefee7bf'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:16.404678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.407318 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:16.413053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:16.415409 np0000000669 nova-compute[97951]: INFO os_vif [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df')
May 13 04:18:16.429687 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:16.490172 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:16.490764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:16.491216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:16.491586 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:16.494759 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:16.495169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:16.576640 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.081s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:16.577220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:16.629062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk 1073741824" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:16.629596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:16.629987 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:16.722266 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:16.722716 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:18:16.722964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:16.798643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attempting to attach volume 203fccaa-ad18-4bee-8e22-bbdd75ba3d2a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:18:16.801086 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:   <alias name="ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a"/>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:   <serial>203fccaa-ad18-4bee-8e22-bbdd75ba3d2a</serial>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:16.801086 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:18:16.812045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:16.812946 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Cannot resize image /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:18:16.812946 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:16.813081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Ensure instance console log exists: /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:16.813301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:16.813571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:16.813727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:16.939968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bea6382f-92c3-45ad-8ddb-75fd409a3a65 req-3c6a5139-18fc-4e5e-94d5-dbf6d93689f2 service nova] Releasing lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:16.943137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquired lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:16.943425 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:16.952452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:16.952758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:16.952893 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] No VIF found with MAC fa:16:3e:bd:76:53, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:16.953426 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Using config drive
May 13 04:18:17.343445 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:18:17.349211 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:17.355931 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:17.355931 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:17.368508 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:17.368508 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.371923 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.392241 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:17.402974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.427203 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.427962 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:17.457898 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'ec2_ids' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:17.468927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.40.100,3260]
May 13 04:18:17.468927 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.40.100,3260] successful.
May 13 04:18:17.468927 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.478612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.50.100,3260]
May 13 04:18:17.478612 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.50.100,3260] successful.
May 13 04:18:17.478612 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.490412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.491214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.511227 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:17.511227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:17.513799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] HCTL ('14', '-', '-', 0) found on session 70 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:17.514013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.519473 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49d448f1-8b98-443a-94dc-e75543ca5341 (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:17.519676 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:17.520331 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:17.520471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:17.521489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] HCTL ('15', '-', '-', 0) found on session 71 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:17.521615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:17.526317 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:17.555282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching for a device in session 70 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:17.555282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:17.559769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching for a device in session 71 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:17.559901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:17.755344 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:17.908602 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Updating instance_info_cache with network_info: [{"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:17.971541 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:17.971756 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'keypairs' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:17.976796 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:17.977078 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:17.977078 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No VIF found with MAC fa:16:3e:d8:8f:a1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:17.977582 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Using config drive
May 13 04:18:18.190876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:18.191092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:18.191285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:18.191536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:18.191536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:18.194019 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Terminating instance
May 13 04:18:18.307957 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:18:18.410911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Releasing lock "refresh_cache-d39c6e2b-5704-468d-9ee9-8b99e062b459" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:18.411473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance network_info: |[{"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:18:18.413015 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Start _get_guest_xml network_info=[{"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:18.417105 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:18.418578 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-775235810', uuid='d39c6e2b-5704-468d-9ee9-8b99e062b459'), owner=OwnerMeta(userid='28c963711e90463b9d488c9e42c2fec1', username='tempest-VolumesActionsTest-1546546431-project-member', projectid='57f90c5bb86747ebb4d155c53086057f', projectname='tempest-VolumesActionsTest-1546546431'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645898.4180748) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:18.420263 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:18.420715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:18.421691 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:18.421921 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:18.423114 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:18.423564 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:18.423781 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:18.423923 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:18.424140 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:18.424291 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:18.424412 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:18.424558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:18.424655 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:18.424767 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:18.424868 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:18.424977 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:18.438673 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-775235810',display_name='tempest-VolumesActionsTest-instance-775235810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-775235810',id=33,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f90c5bb86747ebb4d155c53086057f',ramdisk_id='',reservation_id='r-iljt6vh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546546431',owner_user_name='tempest-VolumesActionsTest-1546546431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:15Z,user_data=None,user_id='28c963711e90463b9d488c9e42c2fec1',uuid=d39c6e2b-5704-468d-9ee9-8b99e062b459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:18.438844 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converting VIF {"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:18.439431 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:18.439893 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lazy-loading 'pci_devices' on Instance uuid d39c6e2b-5704-468d-9ee9-8b99e062b459 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:18.476053 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Object Instance<895c0f15-772c-4b0f-a0b3-dc5469ce3508> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:18.479132 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:18.484714 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:18.506464 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:18.506614 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:18.507685 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:18.507685 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No VIF found with MAC fa:16:3e:a1:eb:fc, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:18.642815 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Creating config drive at /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config
May 13 04:18:18.647812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpso0_itcq {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:18.668663 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Creating config drive at /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.config
May 13 04:18:18.674701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg56j207g {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:18.699519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:18.707167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpso0_itcq" returned: 0 in 0.059s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:18.734207 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.736868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg56j207g" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:18.761390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.881292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:18.881639 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:18.881855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:18.881966 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:18.882242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] No waiting events found dispatching network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:18.884001 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5d640696-5226-4814-9677-9f4600033532 req-910ed86f-d8d4-4b02-83b4-900757a98a87 service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:18.889511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.900843 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.944790 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <uuid>d39c6e2b-5704-468d-9ee9-8b99e062b459</uuid>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <name>instance-00000021</name>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesActionsTest-instance-775235810</nova:name>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:18</nova:creationTime>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:user uuid="28c963711e90463b9d488c9e42c2fec1">tempest-VolumesActionsTest-1546546431-project-member</nova:user>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:project uuid="57f90c5bb86747ebb4d155c53086057f">tempest-VolumesActionsTest-1546546431</nova:project>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         <nova:port uuid="7cfebe86-b441-414f-9602-5abbe6b27b1e">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="serial">d39c6e2b-5704-468d-9ee9-8b99e062b459</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="uuid">d39c6e2b-5704-468d-9ee9-8b99e062b459</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.config"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:ad:dc:de"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <target dev="tap7cfebe86-b4"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/console.log" append="off"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:18.944790 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:18.946789 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Preparing to wait for external event network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:18.946789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:18.946789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:18.946789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:18.946926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-775235810',display_name='tempest-VolumesActionsTest-instance-775235810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-775235810',id=33,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f90c5bb86747ebb4d155c53086057f',ramdisk_id='',reservation_id='r-iljt6vh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546546431',owner_user_name='tempest-VolumesActionsTest-1546546431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:15Z,user_data=None,user_id='28c963711e90463b9d488c9e42c2fec1',uuid=d39c6e2b-5704-468d-9ee9-8b99e062b459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:18:18.947152 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converting VIF {"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:18.947920 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:18.948231 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:18:18.950543 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.950925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:18.951335 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:18:18.952819 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.954425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cd7d453-9846-5adf-a736-b9cfa7441fdf', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:18.956734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:18.973927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.975934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.976683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cfebe86-b4, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:18.977138 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cfebe86-b4, col_values=(('qos', UUID('e47f0d74-dde6-4f44-bc02-3fe8dec107a1')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:18.977408 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cfebe86-b4, col_values=(('external_ids', {'iface-id': '7cfebe86-b441-414f-9602-5abbe6b27b1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:dc:de', 'vm-uuid': 'd39c6e2b-5704-468d-9ee9-8b99e062b459'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:18.979626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:18.979626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:19.001754 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.003159 np0000000669 nova-compute[97951]: INFO os_vif [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4')
May 13 04:18:19.084936 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:19.085260 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:18:19.296471 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99952475400005 future=<Future at 0x7a463c137620 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:19.297194 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998880929000052 future=<Future at 0x7a463c137620 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:19.297295 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998633987999938 future=<Future at 0x7a463c137620 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:19.297488 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Instance destroyed successfully.
May 13 04:18:19.300620 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'resources' on Instance uuid af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:19.331885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found WWN 3300000005b1a9a8a for multipath device dm-5 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:18:19.331885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:19.332439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== connect_volume: return (4503ms) {'type': 'block', 'scsi_wwn': '3300000005b1a9a8a', 'path': '/dev/dm-5', 'multipath_id': '3300000005b1a9a8a'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:19.332679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005b1a9a8a', 'path': '/dev/dm-5', 'multipath_id': '3300000005b1a9a8a'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:18:19.340408 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:19.622375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.766628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.807688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518602650',display_name='tempest-AttachVolumeNegativeTest-server-1518602650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1518602650',id=30,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbaNWvJqwz4UY7wT5PsMEbyA1rxTIk/6b11kPk1PfA0E0VCiF+tyg/fIQKTOEKquiZRknnuoLJSRQ27vrCGyQB3eCYBcwQTtEwdB5LZascShzrk6OyGTHs1nHbBgLzz/A==',key_name='tempest-keypair-497790705',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:38Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-kh8dxa4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=af5a54fc-ebb4-4985-9e99-ce2144cc8ee9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:19.807688 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "address": "fa:16:3e:e5:46:50", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8985c60-f2", "ovs_interfaceid": "a8985c60-f211-4ff4-94f4-3f7ff0d5c14b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:19.808316 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:19.808660 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:19.820067 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.820235 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8985c60-f2, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:19.821156 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.821886 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:19.841600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.844174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Attempting to attach volume b1e4da0a-464f-4ec4-a803-994734da7f2a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:18:19.845008 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.845008 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.845223 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ee8171-aa89-46d7-941c-2a363086bd8b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:19.847696 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.848896 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:19.849188 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:   <alias name="ua-b1e4da0a-464f-4ec4-a803-994734da7f2a"/>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-5"/>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:   <serial>b1e4da0a-464f-4ec4-a803-994734da7f2a</serial>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:19.849188 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:18:19.862390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:19.868562 np0000000669 nova-compute[97951]: INFO os_vif [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:46:50,bridge_name='br-int',has_traffic_filtering=True,id=a8985c60-f211-4ff4-94f4-3f7ff0d5c14b,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8985c60-f2')
May 13 04:18:19.869069 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Deleting instance files /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9_del
May 13 04:18:19.870236 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Deletion of /opt/stack/data/nova/instances/af5a54fc-ebb4-4985-9e99-ce2144cc8ee9_del complete
May 13 04:18:19.894991 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.022681 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.047417 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2f13693-677c-4239-b30b-ceac83bb042b req-8dae5b21-87fc-4f7a-a939-f43364b71209 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:20.048401 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f13693-677c-4239-b30b-ceac83bb042b req-8dae5b21-87fc-4f7a-a939-f43364b71209 service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:20.048834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f13693-677c-4239-b30b-ceac83bb042b req-8dae5b21-87fc-4f7a-a939-f43364b71209 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:20.049019 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2f13693-677c-4239-b30b-ceac83bb042b req-8dae5b21-87fc-4f7a-a939-f43364b71209 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:20.049230 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2f13693-677c-4239-b30b-ceac83bb042b req-8dae5b21-87fc-4f7a-a939-f43364b71209 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Processing event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:20.067868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ddca3755-beda-491d-971f-939b4fc870f5 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.125s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:20.136051 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.143251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.149152 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.186720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.193283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.382639 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Took 1.68 seconds to destroy the instance on the hypervisor.
May 13 04:18:20.384547 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:18:20.384894 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:18:20.385043 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:18:20.385313 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:20.483696 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:20.531349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:20.531349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:20.531349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] No VIF found with MAC fa:16:3e:ad:dc:de, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:20.531638 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Using config drive
May 13 04:18:20.689644 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.696209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.702524 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.737751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.746163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:20.986816 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:20.987166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Acquiring lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:20.988147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:20.989356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:20.989439 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] No waiting events found dispatching network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:20.989593 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-unplugged-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:20.989755 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:20.990098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:20.990274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:20.990446 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:20.990596 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Processing event network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:20.990763 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:20.990921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:20.991069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:20.991211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:20.991362 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] No waiting events found dispatching network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:20.991532 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-edd1fb05-55a4-4264-8580-2de77ae0942d req-5b2b7ec2-2fbb-4059-8b3b-db8f2c6e373b service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received unexpected event network-vif-plugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 for instance with vm_state building and task_state spawning.
May 13 04:18:21.044877 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:21.079451 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:21.079837 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:18:21.083655 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:21.085071 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:21.085071 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:18:21.145930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:21.145930 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645901.1444914, 2c3c381e-5a15-4198-afb9-388efefee7bf => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:21.145930 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] VM Started (Lifecycle Event)
May 13 04:18:21.148581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:21.150739 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance spawned successfully.
May 13 04:18:21.152029 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:18:21.211648 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:21.215593 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Creating config drive at /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.config
May 13 04:18:21.219841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf0ehobiy {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:21.220302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:21.244120 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Rescuing
May 13 04:18:21.251920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:21.252412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:21.252754 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:21.267498 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance spawned successfully.
May 13 04:18:21.286911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf0ehobiy" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:21.568498 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:21.636171 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:21.649726 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:21.654854 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:21.667520 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.667520 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.667715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.667779 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.668000 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.668247 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:21.763230 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:21.763652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:21.763652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:21.763652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No VIF found with MAC fa:16:3e:c8:6d:7e, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:21.767533 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:21.808123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:21.845796 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:21.949598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:22.074470 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Took 1.69 seconds to deallocate network for instance.
May 13 04:18:22.085473 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:22.115170 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8d65365c-24dc-4078-bca5-39db71675752 req-4461e9f7-7426-47a7-9bde-5fd5f2b8d8b9 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:22.115847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8d65365c-24dc-4078-bca5-39db71675752 req-4461e9f7-7426-47a7-9bde-5fd5f2b8d8b9 service nova] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:22.116146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8d65365c-24dc-4078-bca5-39db71675752 req-4461e9f7-7426-47a7-9bde-5fd5f2b8d8b9 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:22.116952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8d65365c-24dc-4078-bca5-39db71675752 req-4461e9f7-7426-47a7-9bde-5fd5f2b8d8b9 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:22.116952 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8d65365c-24dc-4078-bca5-39db71675752 req-4461e9f7-7426-47a7-9bde-5fd5f2b8d8b9 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Processing event network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:22.150531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ebff3af7-67b1-44a2-890b-c33df5fdade2 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.175s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:22.154828 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:22.155169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:22.155250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:22.155371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:22.155541 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:22.155702 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received unexpected event network-vif-plugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with vm_state active and task_state None.
May 13 04:18:22.155851 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2fbcb95a-4d2d-42bf-947e-325b9c7330f9 req-b6ec8cfe-14ef-4d2e-944c-3fad9522c86a service nova] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Received event network-vif-deleted-a8985c60-f211-4ff4-94f4-3f7ff0d5c14b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:22.158753 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:18:22.158962 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645902.1587522, 2c3c381e-5a15-4198-afb9-388efefee7bf => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:22.159123 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] VM Paused (Lifecycle Event)
May 13 04:18:22.174446 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Took 8.39 seconds to spawn the instance on the hypervisor.
May 13 04:18:22.174594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:22.226423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:22.230826 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:22.235303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:22.262351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:22.350763 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:22.498151 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:22.583366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:22.583366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:22.593973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:22.666389 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:22.670813 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645902.6685321, 2c3c381e-5a15-4198-afb9-388efefee7bf => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:22.670813 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] VM Resumed (Lifecycle Event)
May 13 04:18:22.699524 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Took 16.85 seconds to build instance.
May 13 04:18:22.900217 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:22.909518 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:22.911224 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance spawned successfully.
May 13 04:18:22.912998 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:18:23.002518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:23.082769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:23.083003 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:23.171872 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:23.174306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:23.201232 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-56c4a9ef-8c08-406e-9b8b-1a971a770916 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.356s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:23.327227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ca7178ef-4dd4-4d99-8be6-79ac330f31fc tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.271s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:23.419858 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.420058 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.420484 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.421813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.422972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.422972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:23.586345 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:23.678680 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645903.6781063, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:23.678828 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Started (Lifecycle Event)
May 13 04:18:23.928337 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Took 7.56 seconds to spawn the instance on the hypervisor.
May 13 04:18:23.928731 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:24.093972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.511s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:24.095317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.499s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:24.099392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:24.099392 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:18:24.165879 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Deleted allocations for instance af5a54fc-ebb4-4985-9e99-ce2144cc8ee9
May 13 04:18:24.182152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:24.183649 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:24.207932 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:24.207932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:24.209181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:24.209181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:24.209181 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] No waiting events found dispatching network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:24.209807 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-8b75ca1f-f089-4513-b241-a74417cadd63 req-6b5c3c8f-d009-446e-8b3f-f9fc45e4edcb service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received unexpected event network-vif-plugged-7cfebe86-b441-414f-9602-5abbe6b27b1e for instance with vm_state active and task_state None.
May 13 04:18:24.444705 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Took 15.45 seconds to build instance.
May 13 04:18:24.498885 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-changed-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:24.499007 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Refreshing instance network info cache due to event network-changed-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:24.499162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] Acquiring lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:24.499293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] Acquired lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:24.499592 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Refreshing network info cache for port 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:24.625818 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.650629 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.653213 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.676562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.680689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.685802 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645904.6854072, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:24.685925 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Paused (Lifecycle Event)
May 13 04:18:24.710311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.851807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.915367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:24.946767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.958s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:25.002800 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:25.045650 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance destroyed successfully.
May 13 04:18:25.048182 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'numa_topology' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:25.140812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.192512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0f1b868e-f6fc-49c6-b0ab-f8474a31cb2a tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "af5a54fc-ebb4-4985-9e99-ce2144cc8ee9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.996s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:25.198739 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:25.208379 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645905.2079701, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:25.209108 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Resumed (Lifecycle Event)
May 13 04:18:25.250381 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.252419 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.375366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.393833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:18:25.398484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.478542 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:25.507678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.508388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.561092 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attempting a stable device rescue
May 13 04:18:25.629679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.634098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.709753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=97951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 04:18:25.715851 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:25.721516 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:25.725795 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updated VIF entry in instance network info cache for port 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:25.728622 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating instance_info_cache with network_info: [{"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:25.730473 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:18:25.730658 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Creating image(s)
May 13 04:18:25.732225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:25.732225 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:25.732753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:25.732995 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'trusted_certs' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:25.756792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.758643 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.851196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.851717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:18:25.855233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:25.943268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:25.943878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.042985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.047824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.140889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.141517 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.223421 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645906.2226167, d39c6e2b-5704-468d-9ee9-8b99e062b459 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:26.223600 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] VM Started (Lifecycle Event)
May 13 04:18:26.232582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1ab9409-8db4-45c6-bec7-5eaa1e0358aa req-a397d84c-b4c8-4c42-9366-727b959cc521 service nova] Releasing lock "refresh_cache-2c3c381e-5a15-4198-afb9-388efefee7bf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:26.236192 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:26.236602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "b8f868a9b4c835397d596efbd7c29a321a29c607" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:26.237094 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "b8f868a9b4c835397d596efbd7c29a321a29c607" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:26.244945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:26.245087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:26.248681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.249207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:18:26.253442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.341624 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.343099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.453518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.454294 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:18:26.458739 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:26.460084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:26.518740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:26.519531 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12540MB free_disk=73.177978515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:18:26.520596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:26.520896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:26.583638 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:26.583792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:26.584588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:26.584847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:26.585211 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:26.585273 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state rescuing.
May 13 04:18:26.585534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:26.585725 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:26.586189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:26.586442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:26.586529 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:26.586966 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-971029f1-7d19-44b5-a07d-a25345f461e8 req-4dcfaa81-06ef-40cc-b508-2e000b03c076 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state rescuing.
May 13 04:18:26.728608 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:26.731801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:26.747794 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Detaching volume 36055a9b-69dd-44bc-b37b-45142850db35
May 13 04:18:26.792399 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Attempting to driver detach volume 36055a9b-69dd-44bc-b37b-45142850db35 from mountpoint /dev/vdb
May 13 04:18:26.800496 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-36055a9b-69dd-44bc-b37b-45142850db35 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:18:26.801728 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-36055a9b-69dd-44bc-b37b-45142850db35 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:18:26.801910 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Attempting to detach device vdb from instance e23736e9-57ca-4381-be15-40188229ff0c from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:18:26.802224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <alias name="ua-36055a9b-69dd-44bc-b37b-45142850db35"/>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <serial>36055a9b-69dd-44bc-b37b-45142850db35</serial>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:26.802224 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:18:26.818336 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance e23736e9-57ca-4381-be15-40188229ff0c from the persistent domain config.
May 13 04:18:26.818604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] (1/8): Attempting to detach device vdb with device alias ua-36055a9b-69dd-44bc-b37b-45142850db35 from instance e23736e9-57ca-4381-be15-40188229ff0c from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:18:26.818993 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <alias name="ua-36055a9b-69dd-44bc-b37b-45142850db35"/>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <serial>36055a9b-69dd-44bc-b37b-45142850db35</serial>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:26.818993 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:18:27.048874 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.051887 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.052262 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:27.169117 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.part --force-share --output=json" returned: 0 in 0.114s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:27.169117 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] 4c6abf7e-a013-44d9-bff8-1b360a0db3e2 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:18:27.169117 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:18:27.169117 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.part /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:27.239524 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645907.2366304, d39c6e2b-5704-468d-9ee9-8b99e062b459 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:27.239524 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] VM Paused (Lifecycle Event)
May 13 04:18:27.393173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-36055a9b-69dd-44bc-b37b-45142850db35 for instance e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:18:27.409432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.part /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.converted" returned: 0 in 0.241s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:27.427471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:27.539040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607.converted --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:27.545403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "b8f868a9b4c835397d596efbd7c29a321a29c607" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.308s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:27.546370 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.551173 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.552684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "b8f868a9b4c835397d596efbd7c29a321a29c607" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:27.553242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "b8f868a9b4c835397d596efbd7c29a321a29c607" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:27.553766 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.558051 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:27.558546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:27.628831 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e23736e9-57ca-4381-be15-40188229ff0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.629520 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance a26ca192-6544-4d60-b566-17ee3d91bff7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.629691 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.630659 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance b6e65a61-0ae4-402c-9138-cef6ac3ae614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.630851 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 895c0f15-772c-4b0f-a0b3-dc5469ce3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.631069 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 2c3c381e-5a15-4198-afb9-388efefee7bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.631242 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d39c6e2b-5704-468d-9ee9-8b99e062b459 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:18:27.631642 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:18:27.631920 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:18:26 up 32 min,  2 users,  load average: 8.18, 7.16, 3.88\n', 'num_instances': '7', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_4c06d9163829483dafb7a6dcd1a3f194': '1', 'io_workload': '1', 'num_task_rescuing': '1', 'num_proj_e3b639861ec44659ada64bddafc7172d': '1', 'num_proj_016554a7d54c4781a53b6ddb1f2e81e2': '1', 'num_proj_cbf2cd35b50144e09a9d2fa69360c9f6': '1', 'num_proj_e2e949cc9fb441d4af79255215405cc3': '1', 'num_proj_57f90c5bb86747ebb4d155c53086057f': '1', 'num_proj_94e441f4e3754f1692b7d4b86c603ca8': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:18:27.654369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607 --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:27.656068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607,backing_fmt=raw /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.rescue {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:27.719044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8f868a9b4c835397d596efbd7c29a321a29c607,backing_fmt=raw /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.rescue" returned: 0 in 0.063s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:27.719530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "b8f868a9b4c835397d596efbd7c29a321a29c607" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:27.719852 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'migration_context' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:27.744923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:27.753538 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645907.753116, d39c6e2b-5704-468d-9ee9-8b99e062b459 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:27.753731 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] VM Resumed (Lifecycle Event)
May 13 04:18:28.057309 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:28.058433 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:28.222506 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:28.222858 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:28.225464 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start _get_guest_xml network_info=[{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "vif_mac": "fa:16:3e:a1:eb:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4c6abf7e-a013-44d9-bff8-1b360a0db3e2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'a26ca192-6544-4d60-b566-17ee3d91bff7', 'attached_at': '', 'detached_at': '', 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'serial': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'}, 'disk_bus': 'virtio', 'attachment_id': 'dd6c80c2-b333-4138-919f-66bff4704d1b', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:28.225810 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'resources' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:28.257121 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:28.259256 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:28.563778 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:28.728681 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:28.731746 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:28.733275 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-549655183', uuid='a26ca192-6544-4d60-b566-17ee3d91bff7'), owner=OwnerMeta(userid='a537cfdbd3cb43b885ae21a9db152e57', username='tempest-ServerStableDeviceRescueTest-1671909926-project-member', projectid='e3b639861ec44659ada64bddafc7172d', projectname='tempest-ServerStableDeviceRescueTest-1671909926'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "vif_mac": "fa:16:3e:a1:eb:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645908.7328665) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:28.735036 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:28.735461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:28.736461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:28.736668 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:28.737760 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:28.738162 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:28.738936 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:28.739170 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:28.739343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:28.739501 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:28.739777 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:28.739946 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:28.740158 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:28.740222 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:28.740338 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:28.740500 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:28.740678 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'vcpu_model' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:28.763385 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999571444999901 future=<Future at 0x7a46481010d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:28.763656 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645908.763409, e23736e9-57ca-4381-be15-40188229ff0c => ua-36055a9b-69dd-44bc-b37b-45142850db35> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:18:28.769833 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance e23736e9-57ca-4381-be15-40188229ff0c from the live domain config.
May 13 04:18:28.772748 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:18:28.773176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:28.773373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:28.773766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:28.774086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36055a9b-69dd-44bc-b37b-45142850db35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:18:28.774298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:28.810584 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35 (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:28.811105 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9', '72')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:18:28.811105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '61')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:28.812887 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35', '62')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:28.814174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464857e0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:18:28.814505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Removing multipathed devices sde, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:18:28.814925 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flush multipath device 3300000005e7268bb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:18:28.855355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:28.901802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:28.949442 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:18:28.949689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:18:28.952258 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:18:28.969806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:18:28.970152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:18:28.990469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.032949 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.40.100,3260]
May 13 04:18:29.032949 np0000000669 nova-compute[97951]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.40.100,3260] successful.
May 13 04:18:29.032949 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.063772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.070879 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:18:29.071317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.550s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:29.072024 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:18:29.096470 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.140493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.50.100,3260]
May 13 04:18:29.140493 np0000000669 nova-compute[97951]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-36055a9b-69dd-44bc-b37b-45142850db35, portal: 192.168.50.100,3260] successful.
May 13 04:18:29.140493 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.163110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.164290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:29.164290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== disconnect_volume: return (390ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:29.164433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:18:29.242737 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:29.262171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:29.389016 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:29.391832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:29.392175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:29.394266 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:29.394899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:18:29.395378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:29.395637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:29.396542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:29.396902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:18:29.410679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:29.411449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:29.411700 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:18:29.412683 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:29.413336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:29.413644 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:29.424941 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:29.424941 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:18:29.436575 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:18:29.436575 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.443179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.452543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:29.460333 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:29.460611 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:29.463352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:29.463352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:29.463352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] HCTL ('13', '0', '0', 0) found on session 69 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:29.463352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:29.473599 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf7e36ae-b72e-443c-85c7-67b95d8d09d9 (non-flash)
May 13 04:18:29.473858 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:29.474094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:29.474094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:18:29.474833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] HCTL ('12', '0', '0', 0) found on session 68 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:18:29.474833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:18:29.475725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching for a device in session 69 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:29.478151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:29.489800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Searching for a device in session 68 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:18:29.489993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:18:29.629300 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:29.737128 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:29.856497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:30.415661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:18:30.744738 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-059599a2-d1db-4078-b9c8-a7e3b4b40dc3 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.499s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:31.159107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:31.160052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:31.160052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:31.160963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:31.160963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:31.165186 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Terminating instance
May 13 04:18:31.429139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Found WWN 330000000dab73fc6 for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:18:31.429642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:31.429642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '330000000dab73fc6', 'path': '/dev/dm-4', 'multipath_id': '330000000dab73fc6'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:31.429801 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dab73fc6', 'path': '/dev/dm-4', 'multipath_id': '330000000dab73fc6'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:18:31.671507 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:31.682808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:31.682968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:31.683307 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:31.683307 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:31.683307 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:31.685355 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Terminating instance
May 13 04:18:31.694520 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:31.697957 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:31.729596 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:31.731750 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:31.766301 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:31.909018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:31.909316 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:31.909615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:31.909817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:31.909993 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] No waiting events found dispatching network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:31.910162 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7f63a7e1-41eb-428e-b792-c2d5af5e66c1 req-deee4eef-abe8-4ce6-9c07-b64e1e7c4aa7 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:31.940269 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-549655183',display_name='tempest-ServerStableDeviceRescueTest-server-549655183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverstabledevicerescuetest-server-549655183',id=28,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgGn+ovjMLs5pEgOfAzTUALf/n8SK8axWsTN6Ncx3rTPNBqiUZTcgp6rhT6ZtmtGrKZu5xErsOEsk9yIO1jWkY8+BJTsq5AcaMnENkInWTjD09DKcS4QrGSFGvE+Q4OYQ==',key_name='tempest-keypair-1545026129',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:20Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3b639861ec44659ada64bddafc7172d',ramdisk_id='',reservation_id='r-penoq4kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1671909926',owner_user_name='tempest-ServerStableDeviceRescueTest-1671909926-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a537cfdbd3cb43b885ae21a9db152e57',uuid=a26ca192-6544-4d60-b566-17ee3d91bff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "vif_mac": "fa:16:3e:a1:eb:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:31.941117 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converting VIF {"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "vif_mac": "fa:16:3e:a1:eb:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:31.942632 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:31.944126 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'pci_devices' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:32.020346 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999629034999998 future=<Future at 0x7a463c135730 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:32.024823 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Instance destroyed successfully.
May 13 04:18:32.025570 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lazy-loading 'resources' on Instance uuid d39c6e2b-5704-468d-9ee9-8b99e062b459 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:32.191567 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:32.239600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.243975 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.270638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.274414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.294166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.308532 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.426489 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:32.426696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:32.427034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:32.429791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:32.430292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] No waiting events found dispatching network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:32.430292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-36c6f617-0da9-498e-a745-8b236d8a2461 req-3ca6123c-467b-4733-8dc8-6d5feb2923ed service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:32.447023 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:32.452486 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <uuid>a26ca192-6544-4d60-b566-17ee3d91bff7</uuid>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <name>instance-0000001c</name>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-549655183</nova:name>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:28</nova:creationTime>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:user uuid="a537cfdbd3cb43b885ae21a9db152e57">tempest-ServerStableDeviceRescueTest-1671909926-project-member</nova:user>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:project uuid="e3b639861ec44659ada64bddafc7172d">tempest-ServerStableDeviceRescueTest-1671909926</nova:project>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         <nova:port uuid="2999b0b3-03bf-4a9d-b6c5-0598f57f69ee">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="serial">a26ca192-6544-4d60-b566-17ee3d91bff7</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="uuid">a26ca192-6544-4d60-b566-17ee3d91bff7</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <alias name="ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-4"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <serial>203fccaa-ad18-4bee-8e22-bbdd75ba3d2a</serial>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.rescue"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <target dev="vdc" bus="virtio"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <boot order="1"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a1:eb:fc"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <target dev="tap2999b0b3-03"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/console.log" append="off"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:32.452486 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:32.461896 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance destroyed successfully.
May 13 04:18:32.531311 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-775235810',display_name='tempest-VolumesActionsTest-instance-775235810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesactionstest-instance-775235810',id=33,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:23Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57f90c5bb86747ebb4d155c53086057f',ramdisk_id='',reservation_id='r-iljt6vh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1546546431',owner_user_name='tempest-VolumesActionsTest-1546546431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:24Z,user_data=None,user_id='28c963711e90463b9d488c9e42c2fec1',uuid=d39c6e2b-5704-468d-9ee9-8b99e062b459,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:32.531311 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converting VIF {"id": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "address": "fa:16:3e:ad:dc:de", "network": {"id": "0337f849-88c0-46bd-a967-f98a6cb9e6f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1556144173-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57f90c5bb86747ebb4d155c53086057f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfebe86-b4", "ovs_interfaceid": "7cfebe86-b441-414f-9602-5abbe6b27b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:32.531311 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:32.533310 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:32.536057 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.536948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cfebe86-b4, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:32.540178 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:32.563939 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.566364 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999547960999962 future=<Future at 0x7a464836f350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:32.567521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.567784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e47f0d74-dde6-4f44-bc02-3fe8dec107a1) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:32.570420 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Instance destroyed successfully.
May 13 04:18:32.571038 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'resources' on Instance uuid e23736e9-57ca-4381-be15-40188229ff0c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:32.573381 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:32.586982 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:32.591526 np0000000669 nova-compute[97951]: INFO os_vif [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:dc:de,bridge_name='br-int',has_traffic_filtering=True,id=7cfebe86-b441-414f-9602-5abbe6b27b1e,network=Network(0337f849-88c0-46bd-a967-f98a6cb9e6f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfebe86-b4')
May 13 04:18:32.591910 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Deleting instance files /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459_del
May 13 04:18:32.592754 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Deletion of /opt/stack/data/nova/instances/d39c6e2b-5704-468d-9ee9-8b99e062b459_del complete
May 13 04:18:33.072062 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:33.072303 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:33.072538 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:18:33.072719 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:18:33.072859 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.01 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:18:33.077926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2146979515',display_name='tempest-AttachVolumeNegativeTest-server-2146979515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-2146979515',id=26,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvx5Fy/RKL0dhhNSx39GBEWKc37BjypCq9JFE2i8+CfH+PZMQQD2d3qH0ypRykO+evaO6y0NxxybiYG4Q973001O3NwoWNPxbrSG2IjrLmwrJhVPyp//o64FooPn3Wmxw==',key_name='tempest-keypair-1395858231',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:16:32Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-loa29dwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=e23736e9-57ca-4381-be15-40188229ff0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:33.078438 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "d1b390f0-51af-433c-94f1-c1c34298f804", "address": "fa:16:3e:37:93:8a", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b390f0-51", "ovs_interfaceid": "d1b390f0-51af-433c-94f1-c1c34298f804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:33.078838 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:33.079097 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:33.080804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:33.080804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1b390f0-51, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:33.083618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:33.084886 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:33.097549 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:33.100058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:33.100058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef948c8-b79e-4fcb-8960-f845dfd7559c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:33.101889 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:33.104126 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Took 1.43 seconds to destroy the instance on the hypervisor.
May 13 04:18:33.104749 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:18:33.104938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:18:33.105055 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:18:33.105311 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:33.110099 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:33.118524 np0000000669 nova-compute[97951]: INFO os_vif [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:93:8a,bridge_name='br-int',has_traffic_filtering=True,id=d1b390f0-51af-433c-94f1-c1c34298f804,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b390f0-51')
May 13 04:18:33.118904 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Deleting instance files /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c_del
May 13 04:18:33.119876 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Deletion of /opt/stack/data/nova/instances/e23736e9-57ca-4381-be15-40188229ff0c_del complete
May 13 04:18:33.185534 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:33.627193 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 04:18:33.627986 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:18:33.628277 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:18:33.628416 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:18:33.628614 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:33.701626 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:33.967396 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:33.991485 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:33.992028 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:33.992856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:33.992856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:33.992856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] No VIF found with MAC fa:16:3e:a1:eb:fc, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:33.993815 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Using config drive
May 13 04:18:33.997918 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:33.997918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] Acquiring lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:33.998342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:33.999515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:34.000593 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] No waiting events found dispatching network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:34.003408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-76c0bbd8-edc0-4474-ab2d-1b66df88ef89 req-36e063f5-16e9-4f83-a80f-25db71a669b1 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-unplugged-7cfebe86-b441-414f-9602-5abbe6b27b1e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:34.296385 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00039846999993642385 future=<Future at 0x7a463c137620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:34.296852 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Emitting event <LifecycleEvent: 1778645899.2958543, af5a54fc-ebb4-4985-9e99-ce2144cc8ee9 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:34.297002 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:34.297187 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] VM Stopped (Lifecycle Event)
May 13 04:18:34.297300 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.465530037999997 future=<Future at 0x7a46481010d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:34.297395 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.465408296000078 future=<Future at 0x7a46481010d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:34.477800 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Took 1.37 seconds to deallocate network for instance.
May 13 04:18:34.503339 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'ec2_ids' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:34.513238 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:34.514079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] Acquiring lock "e23736e9-57ca-4381-be15-40188229ff0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:34.514270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:34.514357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] Lock "e23736e9-57ca-4381-be15-40188229ff0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:34.514534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] No waiting events found dispatching network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:34.515090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-unplugged-d1b390f0-51af-433c-94f1-c1c34298f804 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:34.515221 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Received event network-vif-deleted-7cfebe86-b441-414f-9602-5abbe6b27b1e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:34.515288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Received event network-vif-deleted-d1b390f0-51af-433c-94f1-c1c34298f804 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:34.515471 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Neutron deleted interface d1b390f0-51af-433c-94f1-c1c34298f804; detaching it from the instance and deleting it from the info cache
May 13 04:18:34.515527 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:34.631266 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:34.659064 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:34.801996 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc6e0919-b7d5-4a02-8c7c-d2dcf2b84c86 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: af5a54fc-ebb4-4985-9e99-ce2144cc8ee9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:34.989609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:34.996936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:35.016778 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:35.016778 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'keypairs' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:35.019811 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5a8d6ed5-cd96-49cd-9276-5cddbe2f1ce7 req-2f1c2775-d014-4570-9f0c-66e6ea180335 service nova] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Detach interface failed, port_id=d1b390f0-51af-433c-94f1-c1c34298f804, reason: Instance e23736e9-57ca-4381-be15-40188229ff0c could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:18:35.160921 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Took 1.53 seconds to deallocate network for instance.
May 13 04:18:35.420592 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:35.424638 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:35.518929 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:35.522448 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:35.666245 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:35.672217 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Creating config drive at /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config.rescue
May 13 04:18:35.678265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ckaneg2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:35.740054 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ckaneg2" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:35.925248 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:36.255198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.294977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.387891 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.437712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.441s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:36.440467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.774s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:36.529736 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Deleted allocations for instance d39c6e2b-5704-468d-9ee9-8b99e062b459
May 13 04:18:36.543674 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:36.543674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:36.544434 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:36.545938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:36.545938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:36.546038 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-949aa15a-5930-49e5-9be7-67457d288ddc req-b641b102-af03-4f50-82f0-73b4b7f50d9a service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state rescuing.
May 13 04:18:36.602793 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.604427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.605402 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.636944 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:36.880177 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:36.880650 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:37.249076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for a26ca192-6544-4d60-b566-17ee3d91bff7 due to new event <LifecycleEvent: 1778645917.248676, a26ca192-6544-4d60-b566-17ee3d91bff7 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:18:37.251364 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645917.248676, a26ca192-6544-4d60-b566-17ee3d91bff7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:37.251364 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Resumed (Lifecycle Event)
May 13 04:18:37.253008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-62722f3a-59e8-4f7f-be6a-79fb6ce20c4d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:37.383194 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:37.551910 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d679f30e-c8c7-44d6-bb76-06825a0dd600 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Lock "d39c6e2b-5704-468d-9ee9-8b99e062b459" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.392s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:37.754102 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:37.756086 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:37.889240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.449s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:37.970075 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Deleted allocations for instance e23736e9-57ca-4381-be15-40188229ff0c
May 13 04:18:38.102928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:38.129320 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:38.129617 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:38.261274 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645918.260806, a26ca192-6544-4d60-b566-17ee3d91bff7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:38.261602 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Started (Lifecycle Event)
May 13 04:18:38.318974 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Unrescuing
May 13 04:18:38.318974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:38.318974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:38.318974 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:38.631741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:18:38.637133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:38.637133 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:38.637287 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:38.637818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:38.637818 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:38.637818 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7e0e8bcc-45a2-4bbc-9d5b-55e2f62b8b1b req-8afdcc7d-c107-47e3-9fb8-290e1c1b8a03 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state rescued and task_state unrescuing.
May 13 04:18:38.764577 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:38.766527 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:38.819967 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:38.986258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-742fe6cf-0319-489e-b1d4-55d514d6d354 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "e23736e9-57ca-4381-be15-40188229ff0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.303s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:39.196987 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:39.197237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:39.200826 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:18:39.200998 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Claim successful on node np0000000669
May 13 04:18:39.207959 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:39.269012 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 04:18:39.377596 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:39.648167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:39.879619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:39.880148 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'flavor' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:40.404556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:40.408698 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:40.436678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:40.439906 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:40.474549 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:40.566591 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:40.566790 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:40.739602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:40.739602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing instance network info cache due to event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:40.739602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:40.739602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:40.739602 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:40.750371 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999702544999991 future=<Future at 0x7a461c754da0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:40.754900 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance destroyed successfully.
May 13 04:18:40.755451 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'numa_topology' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:41.069642 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:41.241089 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:41.257413 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Object Instance<a26ca192-6544-4d60-b566-17ee3d91bff7> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:18:41.536529 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:41.583174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.386s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:41.583924 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:18:41.662302 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updated VIF entry in instance network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:41.662302 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:41.664567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.692718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.694145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.791640 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.983462 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.986732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:41.990389 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:42.022799 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:42.091817 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:18:42.092224 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:18:42.092374 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:42.092526 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:42.169471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:42.169761 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:42.169924 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing instance network info cache due to event network-changed-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:42.170144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Acquiring lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:42.172272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Acquired lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:42.172494 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Refreshing network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:42.249768 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af5d50129ed54c6c936f82fd2394b47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058cb3b364ce4f79940fb32a0e7c463d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:18:42.551057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:42.551504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:42.595038 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:18:42.605159 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for a26ca192-6544-4d60-b566-17ee3d91bff7 due to new event <LifecycleEvent: 1778645922.6036148, a26ca192-6544-4d60-b566-17ee3d91bff7 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:18:42.605159 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645922.6036148, a26ca192-6544-4d60-b566-17ee3d91bff7 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:42.605159 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Resumed (Lifecycle Event)
May 13 04:18:42.606144 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-007419ab-85f5-49e5-9279-1634579a6972 tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:42.674848 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:42.841010 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:42.841182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:42.841317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:42.841435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:42.841540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:42.841642 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state None.
May 13 04:18:42.841730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:42.841837 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:42.841961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:42.842070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:42.842178 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:42.842274 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state None.
May 13 04:18:42.842385 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:42.842485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:42.842591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:42.842694 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:42.845393 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:42.845532 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2b1afdf6-87d0-474c-9926-bfb6f2df7a30 req-ac881ae1-fedf-4a11-804c-35bcd7ea4382 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-plugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state active and task_state None.
May 13 04:18:42.862278 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Successfully created port: 941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:18:43.035279 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:43.054190 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:18:43.098510 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:18:43.106340 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:43.108352 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:43.114855 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:43.164560 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Rebuilding instance
May 13 04:18:43.203442 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updated VIF entry in instance network info cache for port 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:43.203756 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [{"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:43.353234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:43.560010 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Successfully updated port: 941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:18:43.571482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-changed-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:43.571940 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Refreshing instance network info cache due to event network-changed-941cebad-a498-4096-b9a7-620718c5d207. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:43.572160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] Acquiring lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:43.572295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] Acquired lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:43.572443 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Refreshing network info cache for port 941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:43.613139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:43.613304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:43.616164 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:18:43.616280 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Claim successful on node np0000000669
May 13 04:18:43.620336 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645923.6196642, a26ca192-6544-4d60-b566-17ee3d91bff7 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:43.620767 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Started (Lifecycle Event)
May 13 04:18:43.709196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Releasing lock "refresh_cache-a26ca192-6544-4d60-b566-17ee3d91bff7" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:43.709491 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:43.709714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:43.709944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:43.710125 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:43.710281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] No waiting events found dispatching network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:43.710478 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d51291ff-9115-4e0b-b329-cd830f1c78d2 req-fb606132-1e56-4f34-816f-c64140e2e370 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received unexpected event network-vif-unplugged-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee for instance with vm_state rescued and task_state unrescuing.
May 13 04:18:43.763421 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003386289999980363 future=<Future at 0x7a46481010d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:43.763421 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:43.763421 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.2564754090001315 future=<Future at 0x7a463c135730 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:43.763421 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.256382763000147 future=<Future at 0x7a463c135730 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:43.830110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:43.830249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.069746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:44.074993 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:44.108937 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:18:44.110182 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:44.110521 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Creating image(s)
May 13 04:18:44.111060 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:44.111279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.111843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:44.112403 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:44.116539 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:44.117612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:44.141368 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:44.149754 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:44.156364 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:44.213178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:44.213701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:44.214287 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.214886 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:44.218929 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:44.219439 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:44.282739 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:44.335701 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Detaching volume b1e4da0a-464f-4ec4-a803-994734da7f2a
May 13 04:18:44.338249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:44.338756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:44.403649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk 1073741824" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:44.403649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.403649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:44.404877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:44.405126 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.442988 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Attempting to driver detach volume b1e4da0a-464f-4ec4-a803-994734da7f2a from mountpoint /dev/vdb
May 13 04:18:44.447284 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.458392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found disk vdb by alias ua-b1e4da0a-464f-4ec4-a803-994734da7f2a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:18:44.459824 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found disk vdb by alias ua-b1e4da0a-464f-4ec4-a803-994734da7f2a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:18:44.459955 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Attempting to detach device vdb from instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:18:44.460220 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <alias name="ua-b1e4da0a-464f-4ec4-a803-994734da7f2a"/>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-5"/>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <serial>b1e4da0a-464f-4ec4-a803-994734da7f2a</serial>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:44.460220 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:18:44.471244 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully detached device vdb from instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d from the persistent domain config.
May 13 04:18:44.471477 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] (1/8): Attempting to detach device vdb with device alias ua-b1e4da0a-464f-4ec4-a803-994734da7f2a from instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:18:44.471796 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <alias name="ua-b1e4da0a-464f-4ec4-a803-994734da7f2a"/>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-5"/>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <serial>b1e4da0a-464f-4ec4-a803-994734da7f2a</serial>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]: </disk>
May 13 04:18:44.471796 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:18:44.474842 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.523853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:44.525154 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:18:44.525828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:44.634362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:44.634826 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Cannot resize image /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:18:44.635289 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:44.635519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:44.635804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:44.636262 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.636262 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:44.652271 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.674570 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.681748 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.704213 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999628315000109 future=<Future at 0x7a464812e120 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:44.710370 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance destroyed successfully.
May 13 04:18:44.717340 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance destroyed successfully.
May 13 04:18:44.720475 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-845771767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:02Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:44.720475 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:44.720475 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:44.720475 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:44.722483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.722822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5028e97-a0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:44.724478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.727148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:44.727934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.728151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc85b1a7-344e-485e-9675-d817deb45d24) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:44.728736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.729219 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:44.729759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:44.732366 np0000000669 nova-compute[97951]: INFO os_vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0')
May 13 04:18:44.734890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:18:44.735465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:44.737220 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:44.737721 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:44.738170 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:18:44.738407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:44.774969 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:44.775227 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:44.775364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '71')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:18:44.775364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '64')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:44.776199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '65')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:44.776868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482145e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:18:44.777046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:18:44.777248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flush multipath device 3300000008864b09c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:18:44.786529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17837ee3-631c-4270-bb7b-b799b62b1ccf req-27479db1-4d9d-4390-9df9-98e2bd52139a service nova] Releasing lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:44.787628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquired lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:44.790648 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:44.837204 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:44.883234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:44.914765 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:44.915394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:44.915601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.915759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:44.915937 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:44.916116 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received unexpected event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with vm_state active and task_state rebuilding.
May 13 04:18:44.916249 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:44.916414 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:44.916563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:44.916703 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:44.916833 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:44.916966 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-6658b7a3-d42a-4eb2-9dd8-9bddacc643f2 req-4f942216-db9c-4782-9366-0fbae101ab5a service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received unexpected event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with vm_state active and task_state rebuilding.
May 13 04:18:44.931566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:18:44.932027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:18:44.932994 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:18:44.947984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:18:44.948198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:18:44.964144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:44.998742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260]
May 13 04:18:44.998742 np0000000669 nova-compute[97951]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260] successful.
May 13 04:18:44.998742 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.016314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.028100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.052618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:45.052777 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:45.060920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260]
May 13 04:18:45.060920 np0000000669 nova-compute[97951]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260] successful.
May 13 04:18:45.060920 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.062419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645925.06219, c6db6f9c-40f7-4d97-ab8b-46efcb89223d => ua-b1e4da0a-464f-4ec4-a803-994734da7f2a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:18:45.064356 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b1e4da0a-464f-4ec4-a803-994734da7f2a for instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:18:45.067625 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully detached device vdb from instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d from the live domain config.
May 13 04:18:45.068688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:18:45.069065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:45.069286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:45.074932 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.075210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:45.075354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== disconnect_volume: return (339ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:45.075578 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:18:45.075966 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deleting instance files /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614_del
May 13 04:18:45.076414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:45.076865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e4da0a-464f-4ec4-a803-994734da7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:18:45.077037 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:18:45.077648 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deletion of /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614_del complete
May 13 04:18:45.105206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.105206 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.105206 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:45.105206 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:45.105206 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:45.105514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.105514 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.105514 np0000000669 nova-compute[97951]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:45.105514 np0000000669 nova-compute[97951]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a (non-flash)
May 13 04:18:45.105514 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:45.105688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '71')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:18:45.105766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '70')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:45.106927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a', '71')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:45.107846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648214220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:18:45.108148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Removing multipathed devices sdj, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:18:45.111135 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flush multipath device 3300000005b1a9a8a {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:18:45.148861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:45.195141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:18:45.253070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:18:45.253339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:18:45.254114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:18:45.265535 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:18:45.265760 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:18:45.279033 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.320957 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.40.100,3260]
May 13 04:18:45.320957 np0000000669 nova-compute[97951]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.40.100,3260] successful.
May 13 04:18:45.320957 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.336615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.347110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.357279 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:45.378451 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.50.100,3260]
May 13 04:18:45.378451 np0000000669 nova-compute[97951]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-b1e4da0a-464f-4ec4-a803-994734da7f2a, portal: 192.168.50.100,3260] successful.
May 13 04:18:45.378451 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.403901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:18:45.404096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:45.404243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== disconnect_volume: return (334ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:45.404389 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:18:45.518376 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:45.555852 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:45.653523 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Updating instance_info_cache with network_info: [{"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:45.658370 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b6e65a61-0ae4-402c-9138-cef6ac3ae614 could not be found.
May 13 04:18:45.659346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:18:45.659620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:45.659755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:45.660030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:18:45.660270 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:18:45.660408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:18:45.683517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.683517 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.683517 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:18:45.683820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.683820 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:18:45.683820 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:18:45.684052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:18:45.684249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:45.684444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:18:45.684619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:18:45.684764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:18:45.684897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648215580>, {}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:18:45.685360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Disconnecting from: [] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:18:45.685360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:18:45.685410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== disconnect_volume: return (25ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:45.685539 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:18:45.957132 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:46.063951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.450s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:46.064534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:18:46.157350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Releasing lock "refresh_cache-bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:46.158315 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance network_info: |[{"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:18:46.160734 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Start _get_guest_xml network_info=[{"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:46.161535 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:46.164078 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-862384673', uuid='bfa2de5a-1a4c-4ef4-a2de-120966dba9eb'), owner=OwnerMeta(userid='af5d50129ed54c6c936f82fd2394b47a', username='tempest-VolumesNegativeTest-42147450-project-member', projectid='058cb3b364ce4f79940fb32a0e7c463d', projectname='tempest-VolumesNegativeTest-42147450'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645926.1626458) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:46.164410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:46.164826 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:46.166471 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:46.166749 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:46.167895 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:46.168361 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:46.168572 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:46.168716 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:46.168892 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:46.169037 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:46.169185 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:46.169412 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:46.169572 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:46.169904 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:46.169904 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:46.170084 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:46.198519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-862384673',display_name='tempest-VolumesNegativeTest-instance-862384673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesnegativetest-instance-862384673',id=34,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='058cb3b364ce4f79940fb32a0e7c463d',ramdisk_id='',reservation_id='r-v1f660lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-42147450',owner_user_name='tempest-VolumesNegativeTest-42147450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:43Z,user_data=None,user_id='af5d50129ed54c6c936f82fd2394b47a',uuid=bfa2de5a-1a4c-4ef4-a2de-120966dba9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:46.198629 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converting VIF {"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:46.199229 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:46.199919 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lazy-loading 'pci_devices' on Instance uuid bfa2de5a-1a4c-4ef4-a2de-120966dba9eb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:46.570964 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:18:46.571781 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:18:46.571922 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:46.572212 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:46.679687 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b11065076cd40ffaa5099174eda4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c06d9163829483dafb7a6dcd1a3f194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:18:46.702939 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <uuid>bfa2de5a-1a4c-4ef4-a2de-120966dba9eb</uuid>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <name>instance-00000022</name>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesNegativeTest-instance-862384673</nova:name>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:46</nova:creationTime>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:user uuid="af5d50129ed54c6c936f82fd2394b47a">tempest-VolumesNegativeTest-42147450-project-member</nova:user>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:project uuid="058cb3b364ce4f79940fb32a0e7c463d">tempest-VolumesNegativeTest-42147450</nova:project>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         <nova:port uuid="941cebad-a498-4096-b9a7-620718c5d207">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="192.168.233.8" ipVersion="4"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="serial">bfa2de5a-1a4c-4ef4-a2de-120966dba9eb</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="uuid">bfa2de5a-1a4c-4ef4-a2de-120966dba9eb</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.config"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:39:1a:c5"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <target dev="tap941cebad-a4"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/console.log" append="off"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:46.702939 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Preparing to wait for external event network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-862384673',display_name='tempest-VolumesNegativeTest-instance-862384673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesnegativetest-instance-862384673',id=34,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='058cb3b364ce4f79940fb32a0e7c463d',ramdisk_id='',reservation_id='r-v1f660lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-42147450',owner_user_name='tempest-VolumesNegativeTest-42147450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:43Z,user_data=None,user_id='af5d50129ed54c6c936f82fd2394b47a',uuid=bfa2de5a-1a4c-4ef4-a2de-120966dba9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converting VIF {"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e17d3e2b-a860-59b7-8434-fc18b262e98b', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.709660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:46.712353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.712353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.712353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap941cebad-a4, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:46.712637 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap941cebad-a4, col_values=(('qos', UUID('06c9074d-beab-4e44-b341-3eb97204cae8')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:46.712826 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap941cebad-a4, col_values=(('external_ids', {'iface-id': '941cebad-a498-4096-b9a7-620718c5d207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:1a:c5', 'vm-uuid': 'bfa2de5a-1a4c-4ef4-a2de-120966dba9eb'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:46.713713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.715174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:46.720814 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:46.721984 np0000000669 nova-compute[97951]: INFO os_vif [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4')
May 13 04:18:46.890537 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Preparing to wait for external event volume-reimaged-b5ff2a40-effd-4a6f-837c-4809bb8c128c {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:46.891136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:46.891136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:46.891295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:46.962896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44df68f5-b2b0-4b03-bb23-48df2c1693a5 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.132s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:47.020895 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000959168999997928 future=<Future at 0x7a463c135730 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.021071 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.021116 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.5441492560000825 future=<Future at 0x7a464836f350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.021457 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Emitting event <LifecycleEvent: 1778645912.0197358, d39c6e2b-5704-468d-9ee9-8b99e062b459 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:47.021491 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.5437847640000655 future=<Future at 0x7a464836f350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.021622 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] VM Stopped (Lifecycle Event)
May 13 04:18:47.077160 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:18:47.112256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:47.112256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:47.112256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:47.112256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:47.112256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:47.113985 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Terminating instance
May 13 04:18:47.202951 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Successfully created port: e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:18:47.524238 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: d39c6e2b-5704-468d-9ee9-8b99e062b459] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:47.565620 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003203179999218264 future=<Future at 0x7a464836f350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.566146 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Emitting event <LifecycleEvent: 1778645912.5651796, e23736e9-57ca-4381-be15-40188229ff0c => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:47.566337 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.566546 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] VM Stopped (Lifecycle Event)
May 13 04:18:47.566692 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=8.183340206999901 future=<Future at 0x7a461c754da0 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.566786 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=8.183208105999938 future=<Future at 0x7a461c754da0 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.567361 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.567455 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.136129210000036 future=<Future at 0x7a464812e120 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.568022 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=12.135565692 future=<Future at 0x7a464812e120 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.580153 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:18:47.617535 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:47.644381 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.648228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.681198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.713355 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.844011 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Successfully updated port: e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:18:47.892691 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:47.893098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:47.893226 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:47.893673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:47.893673 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] No waiting events found dispatching network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:47.893673 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-56625efe-41e2-47cc-bb62-b7e5d3d825c3 req-406318c8-c920-484d-89ae-5fa15555812f service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:47.948873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.967483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:47.974813 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999654575000022 future=<Future at 0x7a463c187800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:47.975610 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Instance destroyed successfully.
May 13 04:18:47.976068 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'resources' on Instance uuid c6db6f9c-40f7-4d97-ab8b-46efcb89223d {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:48.070272 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: e23736e9-57ca-4381-be15-40188229ff0c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:48.245251 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:48.245420 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:48.245547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] No VIF found with MAC fa:16:3e:39:1a:c5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:48.246000 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Using config drive
May 13 04:18:48.344917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:48.345034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquired lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:48.345179 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:18:48.480489 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-194768262',display_name='tempest-VolumesBackupsTest-instance-194768262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-194768262',id=29,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3PhUCJsxKrN7H4Ogrs6qXQFAjcxoU2giw6QvE8YT/pOpp+DZqiCjGrUkPFJRm3uv843mN2RQ3aIJ7lEoDqvetKQrDe2XQc5D03tdH59lt4evPmP82wCZnnR0VmO0dQFA==',key_name='tempest-keypair-395297174',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:17:33Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-h9k5nho0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=c6db6f9c-40f7-4d97-ab8b-46efcb89223d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:48.480489 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e65deb72-0c49-422a-92ee-b4c9e4777021", "address": "fa:16:3e:c8:6d:7e", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape65deb72-0c", "ovs_interfaceid": "e65deb72-0c49-422a-92ee-b4c9e4777021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:48.480489 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:48.480489 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:48.481952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.482152 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape65deb72-0c, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:48.486172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.486172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:48.494145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.494888 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.495717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b73c2f76-07ff-48ee-ae5f-708773b22cd7) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:48.496568 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.499888 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.500236 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:48.506961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:48.509380 np0000000669 nova-compute[97951]: INFO os_vif [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6d:7e,bridge_name='br-int',has_traffic_filtering=True,id=e65deb72-0c49-422a-92ee-b4c9e4777021,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65deb72-0c')
May 13 04:18:48.509380 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Deleting instance files /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d_del
May 13 04:18:48.509867 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Deletion of /opt/stack/data/nova/instances/c6db6f9c-40f7-4d97-ab8b-46efcb89223d_del complete
May 13 04:18:48.588163 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:18:48.589242 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:48.589466 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Creating image(s)
May 13 04:18:48.589956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:48.590114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:48.590519 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:48.590935 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:48.593193 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:48.594302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.723187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:48.723762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:48.724338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:48.724877 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:48.728184 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:18:48.728520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.757412 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:48.819534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:48.823352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.877353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk 1073741824" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:48.879360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:48.879360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.933877 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Creating config drive at /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.config
May 13 04:18:48.936941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3oobpv3 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.954101 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:18:48.968885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:48.969912 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:18:48.970426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:48.999859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3oobpv3" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:49.020600 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:18:49.021664 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:18:49.021839 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:18:49.021939 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:18:49.022441 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:49.075204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Cannot resize image /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Ensure instance console log exists: /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:49.081681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:49.153252 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:49.166521 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:49.303791 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updating instance_info_cache with network_info: [{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:49.492007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.494706 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.563807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.564002 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.646468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.651701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.751952 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ca387b2e-f18a-4122-bf1b-198c34e27793 req-3fad6ebd-8816-480c-9c06-633b6f671a87 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-deleted-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:49.751952 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ca387b2e-f18a-4122-bf1b-198c34e27793 req-3fad6ebd-8816-480c-9c06-633b6f671a87 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Neutron deleted interface e65deb72-0c49-422a-92ee-b4c9e4777021; detaching it from the instance and deleting it from the info cache
May 13 04:18:49.751952 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ca387b2e-f18a-4122-bf1b-198c34e27793 req-3fad6ebd-8816-480c-9c06-633b6f671a87 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:49.806477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Releasing lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:49.806477 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Instance network_info: |[{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:18:49.808557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Start _get_guest_xml network_info=[{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:49.814885 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:18:49.816413 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1788335114', uuid='ebcb283c-a661-421d-b276-132c83950c5a'), owner=OwnerMeta(userid='6b11065076cd40ffaa5099174eda4db9', username='tempest-AttachVolumeNegativeTest-1451451802-project-member', projectid='4c06d9163829483dafb7a6dcd1a3f194', projectname='tempest-AttachVolumeNegativeTest-1451451802'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645929.8159711) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:49.823860 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:49.824270 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:49.825646 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:49.825844 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:49.827235 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:49.827990 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:49.828129 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:49.828285 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:49.828485 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:49.828606 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:49.828739 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:49.828980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:49.829128 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:49.829296 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:49.829461 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:49.829625 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:49.852118 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1788335114',display_name='tempest-AttachVolumeNegativeTest-server-1788335114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1788335114',id=35,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM12W05AffzMk/Znp63ocP5v1muRFhfsEIVghvi301ziW8kbDfk0Nzo853qugJQrj8RuTdHFpN0vS+du3qilTpqp36C8w0E5tY91aTD28ETUZBG0PRvpoybKzQ3HnXj2yg==',key_name='tempest-keypair-937314002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-ty9a2e5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=ebcb283c-a661-421d-b276-132c83950c5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:18:49.852362 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:49.853074 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:49.853731 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'pci_devices' on Instance uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:49.891865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.894814 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.897407 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.923645 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:49.991207 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-changed-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:49.991442 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Refreshing instance network info cache due to event network-changed-e9bf2e16-f33c-4337-bc33-e01983584e7a. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:49.991495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Acquiring lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:49.991587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Acquired lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:49.992445 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Refreshing network info cache for port e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:50.164169 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:50.258246 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ca387b2e-f18a-4122-bf1b-198c34e27793 req-3fad6ebd-8816-480c-9c06-633b6f671a87 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Detach interface failed, port_id=e65deb72-0c49-422a-92ee-b4c9e4777021, reason: Instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:18:50.358269 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] End _get_guest_xml xml=<domain type="qemu">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <uuid>ebcb283c-a661-421d-b276-132c83950c5a</uuid>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <name>instance-00000023</name>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1788335114</nova:name>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:49</nova:creationTime>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:user uuid="6b11065076cd40ffaa5099174eda4db9">tempest-AttachVolumeNegativeTest-1451451802-project-member</nova:user>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:project uuid="4c06d9163829483dafb7a6dcd1a3f194">tempest-AttachVolumeNegativeTest-1451451802</nova:project>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         <nova:port uuid="e9bf2e16-f33c-4337-bc33-e01983584e7a">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <system>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="serial">ebcb283c-a661-421d-b276-132c83950c5a</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="uuid">ebcb283c-a661-421d-b276-132c83950c5a</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </system>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <os>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </os>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <features>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </features>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   <devices>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.config"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </disk>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:8e:97:53"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <target dev="tape9bf2e16-f3"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </interface>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/console.log" append="off"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </serial>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <video>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </video>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </rng>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:   </devices>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]: </domain>
May 13 04:18:50.358269 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:18:50.358269 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Preparing to wait for external event network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:18:50.360996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:50.360996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:50.360996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:50.360996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1788335114',display_name='tempest-AttachVolumeNegativeTest-server-1788335114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1788335114',id=35,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM12W05AffzMk/Znp63ocP5v1muRFhfsEIVghvi301ziW8kbDfk0Nzo853qugJQrj8RuTdHFpN0vS+du3qilTpqp36C8w0E5tY91aTD28ETUZBG0PRvpoybKzQ3HnXj2yg==',key_name='tempest-keypair-937314002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-ty9a2e5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=ebcb283c-a661-421d-b276-132c83950c5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:18:50.360996 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:50.361387 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:50.361698 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:18:50.363104 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.363638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:50.363879 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:18:50.365566 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.365789 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c6a79cc-8c16-53db-8622-61ecd7802276', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:50.369460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.370537 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:50.372695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.372838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9bf2e16-f3, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:50.373127 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9bf2e16-f3, col_values=(('qos', UUID('ddcf77d3-6cca-473e-9d14-636f6797edbe')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:50.373867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9bf2e16-f3, col_values=(('external_ids', {'iface-id': 'e9bf2e16-f33c-4337-bc33-e01983584e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:97:53', 'vm-uuid': 'ebcb283c-a661-421d-b276-132c83950c5a'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:50.376267 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.377345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:50.381495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:50.382620 np0000000669 nova-compute[97951]: INFO os_vif [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3')
May 13 04:18:50.414469 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645930.4139504, bfa2de5a-1a4c-4ef4-a2de-120966dba9eb => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:50.414674 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] VM Started (Lifecycle Event)
May 13 04:18:50.493976 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:50.667818 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Took 1.65 seconds to deallocate network for instance.
May 13 04:18:50.775382 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:50.918408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:50.921850 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645930.9215796, bfa2de5a-1a4c-4ef4-a2de-120966dba9eb => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:50.921980 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] VM Paused (Lifecycle Event)
May 13 04:18:50.948008 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updated VIF entry in instance network info cache for port e9bf2e16-f33c-4337-bc33-e01983584e7a. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:18:50.948309 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updating instance_info_cache with network_info: [{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:51.173775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:51.173900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:51.426935 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:51.430159 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:51.451921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Releasing lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:18:51.452094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:51.452309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Acquiring lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:51.452515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:51.452618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:51.452752 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] No waiting events found dispatching network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:51.452863 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97de77e-4091-4855-a2c3-9df4a49fb95d req-3da30dd0-82c6-42fa-9713-fca807c1da39 service nova] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Received event network-vif-unplugged-e65deb72-0c49-422a-92ee-b4c9e4777021 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:51.577507 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:51.577809 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:51.842004 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:51.842458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:51.842562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Processing event network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:51.843794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] No waiting events found dispatching network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:51.844542 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e4314606-1adb-4020-b8b0-1dd9f75f7ddc req-70ca3eef-febf-4e7d-96af-c962fe4b57d0 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received unexpected event network-vif-plugged-941cebad-a498-4096-b9a7-620718c5d207 for instance with vm_state building and task_state spawning.
May 13 04:18:51.847778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:51.857980 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance spawned successfully.
May 13 04:18:51.858299 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:18:51.906399 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:51.906668 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:18:51.906668 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:8e:97:53, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:18:51.907316 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Using config drive
May 13 04:18:51.932844 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:18:51.933031 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645931.932859, bfa2de5a-1a4c-4ef4-a2de-120966dba9eb => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:51.933181 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] VM Resumed (Lifecycle Event)
May 13 04:18:52.081844 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:52.367431 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.367693 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.368159 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.369522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.370239 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.370968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:52.417391 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:52.437354 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:52.439944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:52.589621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.415s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:52.610830 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Creating config drive at /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.config
May 13 04:18:52.615916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m12_olo {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:52.658246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:52.691065 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Deleted allocations for instance c6db6f9c-40f7-4d97-ab8b-46efcb89223d
May 13 04:18:52.700586 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m12_olo" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:18:52.878306 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Took 8.77 seconds to spawn the instance on the hypervisor.
May 13 04:18:52.878306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:52.942782 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:18:53.230494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.265659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.396841 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.401717 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Took 14.26 seconds to build instance.
May 13 04:18:53.536292 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ac5f752-baad-4c29-94e1-178e90416aac req-4d584da4-4d1b-4582-a4ea-edb10dd2bbdc service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:53.537006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ac5f752-baad-4c29-94e1-178e90416aac req-4d584da4-4d1b-4582-a4ea-edb10dd2bbdc service nova] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:53.537006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ac5f752-baad-4c29-94e1-178e90416aac req-4d584da4-4d1b-4582-a4ea-edb10dd2bbdc service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:53.537114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ac5f752-baad-4c29-94e1-178e90416aac req-4d584da4-4d1b-4582-a4ea-edb10dd2bbdc service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:53.537415 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ac5f752-baad-4c29-94e1-178e90416aac req-4d584da4-4d1b-4582-a4ea-edb10dd2bbdc service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Processing event network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:53.683200 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.688203 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.696959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.710506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-68d7a8ee-34da-4c26-994c-db800aa089d6 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "c6db6f9c-40f7-4d97-ab8b-46efcb89223d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.598s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:53.720639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:53.907285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-478970f3-d0e4-4e36-90a8-3ebb4cd691fc tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.777s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:54.294273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:54.294637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:54.294915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:54.295144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:54.295337 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:54.298565 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Terminating instance
May 13 04:18:54.600657 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645934.6002548, ebcb283c-a661-421d-b276-132c83950c5a => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:54.602015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:54.603368 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] VM Started (Lifecycle Event)
May 13 04:18:54.605368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:18:54.609885 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Instance spawned successfully.
May 13 04:18:54.610370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:18:54.655510 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:54.804202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:54.817387 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d75cdbb0-a44c-4554-9840-145b85555876 req-6d6f33ab-e9ad-4068-856d-ba2d90c7cf18 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event volume-reimaged-b5ff2a40-effd-4a6f-837c-4809bb8c128c {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:54.817387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d75cdbb0-a44c-4554-9840-145b85555876 req-6d6f33ab-e9ad-4068-856d-ba2d90c7cf18 service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:54.817533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d75cdbb0-a44c-4554-9840-145b85555876 req-6d6f33ab-e9ad-4068-856d-ba2d90c7cf18 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:54.818431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d75cdbb0-a44c-4554-9840-145b85555876 req-6d6f33ab-e9ad-4068-856d-ba2d90c7cf18 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:54.818431 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d75cdbb0-a44c-4554-9840-145b85555876 req-6d6f33ab-e9ad-4068-856d-ba2d90c7cf18 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Processing event volume-reimaged-b5ff2a40-effd-4a6f-837c-4809bb8c128c {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:18:54.818978 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance event wait completed in 7 seconds for volume-reimaged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:18:54.838845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:54.842691 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:54.865855 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:54.873678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:54.906203 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.030069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:55.031391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:55.031391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:55.033002 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:55.033798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] No waiting events found dispatching network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:55.033798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f43f4c15-7d8a-4258-9a17-ef26c3c174e8 req-6d046275-eb0f-4828-b0cf-d4425805fcec service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:55.108794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:55.118120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:55.121378 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.121648 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.121998 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.122148 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.122468 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.122719 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:18:55.132747 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.144564 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.173756 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Instance destroyed successfully.
May 13 04:18:55.174494 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lazy-loading 'resources' on Instance uuid bfa2de5a-1a4c-4ef4-a2de-120966dba9eb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:55.324398 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Booting with volume b5ff2a40-effd-4a6f-837c-4809bb8c128c at /dev/vda
May 13 04:18:55.376875 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.402520 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:55.418372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:18:55.446721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:18:55.501154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:18:55.501990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:18:55.506442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.514048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:18:55.515134 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:febd:7653', 'fe80::fc16:3eff:fed8:8fa1', 'fe80::c0fb:9ff:fee9:b80', 'fe80::44c4:37ff:fec4:9a06', 'fe80::fc16:3eff:fea1:ebfc', 'fe80::3888:77ff:fecf:8e8a', 'fe80::fc16:3eff:fe8e:9753', 'fe80::b4ff:dbff:fee0:96cd'] 
May 13 04:18:55.515288 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:18:55.515437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:18:55.515662 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:18:55.515906 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating existing volume attachment record: 08d9687d-49ce-4d55-a041-f4aeb61c8fbd {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:18:55.605069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:55.608734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:55.608734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:55.608734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:55.608734 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] No waiting events found dispatching network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:55.608734 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-bf754dc4-78cd-4964-a658-58dbc3395d11 req-90357885-c221-4b12-b76c-d21b4b7a4887 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received unexpected event network-vif-plugged-e9bf2e16-f33c-4337-bc33-e01983584e7a for instance with vm_state building and task_state spawning.
May 13 04:18:55.625998 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:18:55.626558 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645935.6262035, ebcb283c-a661-421d-b276-132c83950c5a => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:55.626745 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] VM Paused (Lifecycle Event)
May 13 04:18:55.633592 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Took 7.04 seconds to spawn the instance on the hypervisor.
May 13 04:18:55.633592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:55.679194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-862384673',display_name='tempest-VolumesNegativeTest-instance-862384673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesnegativetest-instance-862384673',id=34,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:52Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='058cb3b364ce4f79940fb32a0e7c463d',ramdisk_id='',reservation_id='r-v1f660lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-42147450',owner_user_name='tempest-VolumesNegativeTest-42147450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:53Z,user_data=None,user_id='af5d50129ed54c6c936f82fd2394b47a',uuid=bfa2de5a-1a4c-4ef4-a2de-120966dba9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:18:55.680572 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converting VIF {"id": "941cebad-a498-4096-b9a7-620718c5d207", "address": "fa:16:3e:39:1a:c5", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap941cebad-a4", "ovs_interfaceid": "941cebad-a498-4096-b9a7-620718c5d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:18:55.684634 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:18:55.684795 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:18:55.689082 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.689490 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap941cebad-a4, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:55.691618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.692784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:55.693832 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.694580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06c9074d-beab-4e44-b341-3eb97204cae8) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:18:55.695469 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:55.696071 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:18:55.698548 np0000000669 nova-compute[97951]: INFO os_vif [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1a:c5,bridge_name='br-int',has_traffic_filtering=True,id=941cebad-a498-4096-b9a7-620718c5d207,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap941cebad-a4')
May 13 04:18:55.698944 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Deleting instance files /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb_del
May 13 04:18:55.699631 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Deletion of /opt/stack/data/nova/instances/bfa2de5a-1a4c-4ef4-a2de-120966dba9eb_del complete
May 13 04:18:56.132408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:56.135960 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645936.135632, ebcb283c-a661-421d-b276-132c83950c5a => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:56.136208 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] VM Resumed (Lifecycle Event)
May 13 04:18:56.151764 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Took 12.59 seconds to build instance.
May 13 04:18:56.211714 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 04:18:56.212405 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:18:56.212632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:18:56.212768 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:18:56.213061 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:56.373611 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:56.639502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:18:56.642405 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:18:56.654580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.103s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:57.103679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:57.103756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] Acquiring lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:57.103923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:57.104043 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:57.104170 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] No waiting events found dispatching network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:57.104276 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-unplugged-941cebad-a498-4096-b9a7-620718c5d207 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:18:57.104404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Received event network-vif-deleted-941cebad-a498-4096-b9a7-620718c5d207 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:57.104767 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Neutron deleted interface 941cebad-a498-4096-b9a7-620718c5d207; detaching it from the instance and deleting it from the info cache
May 13 04:18:57.104767 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:57.145166 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999641752000116 future=<Future at 0x7a46481ebcb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:57.165655 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:18:57.609248 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a71800eb-bf63-4d49-b92d-d81a3f62fbbe req-bf41c404-2861-4ff7-844f-900dde0a5d67 service nova] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Detach interface failed, port_id=941cebad-a498-4096-b9a7-620718c5d207, reason: Instance bfa2de5a-1a4c-4ef4-a2de-120966dba9eb could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:18:57.661434 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:18:57.661781 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating image(s)
May 13 04:18:57.663396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:18:57.663396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Ensure instance console log exists: /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:18:57.664259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:57.664471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:57.664661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:57.666377 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start _get_guest_xml network_info=[{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T04:09:35Z,direct_url=<?>,disk_format='qcow2',id=592e03e6-ecc4-4529-9aa6-c500693e9d97,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T04:09:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b6e65a61-0ae4-402c-9138-cef6ac3ae614', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'serial': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c'}, 'disk_bus': 'virtio', 'attachment_id': '08d9687d-49ce-4d55-a041-f4aeb61c8fbd', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:18:57.667040 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Took 1.45 seconds to deallocate network for instance.
May 13 04:18:57.677361 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 13 04:18:57.678755 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='592e03e6-ecc4-4529-9aa6-c500693e9d97', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-845771767', uuid='b6e65a61-0ae4-402c-9138-cef6ac3ae614'), owner=OwnerMeta(userid='60d575550f71492580f700f334bc84b0', username='tempest-ServerActionsV293TestJSON-1586826136-project-member', projectid='cbf2cd35b50144e09a9d2fa69360c9f6', projectname='tempest-ServerActionsV293TestJSON-1586826136'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645937.6783655) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:18:57.686234 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:18:57.686676 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:18:57.689313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:18:57.689313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:18:57.689313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T04:09:35Z,direct_url=<?>,disk_format='qcow2',id=592e03e6-ecc4-4529-9aa6-c500693e9d97,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T04:09:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:18:57.691005 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:18:57.691475 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:18:57.691475 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:18:57.691475 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:18:57.691609 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:18:57.691697 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6e65a61-0ae4-402c-9138-cef6ac3ae614 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:18:58.175632 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:58.176067 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:58.206233 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:18:58.206725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:18:58.206869 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:18:58.553370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:18:58.553652 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:18:59.056513 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:18:59.150670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:59.150807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:59.151361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:59.153280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:59.153280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:59.158216 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Terminating instance
May 13 04:18:59.182968 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-changed-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:59.182968 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Refreshing instance network info cache due to event network-changed-e9bf2e16-f33c-4337-bc33-e01983584e7a. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:18:59.182968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] Acquiring lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:18:59.182968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] Acquired lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:18:59.182968 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Refreshing network info cache for port e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:18:59.565536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.390s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:59.630842 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Deleted allocations for instance bfa2de5a-1a4c-4ef4-a2de-120966dba9eb
May 13 04:18:59.658580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:59.662506 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:18:59.682633 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:59.687635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:59.687635 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:18:59.705065 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004921570000533393 future=<Future at 0x7a464812e120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:59.705065 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:59.705065 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.2701135159998103 future=<Future at 0x7a463c187800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:59.705065 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.269999699999971 future=<Future at 0x7a463c187800 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:18:59.706247 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Emitting event <LifecycleEvent: 1778645924.7035148, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:18:59.707210 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Stopped (Lifecycle Event)
May 13 04:18:59.715819 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:59.747187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:18:59.871757 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:18:59.873189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:18:59.873519 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:18:59.873754 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:18:59.873969 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:18:59.874149 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-873c1b17-12e9-41b2-a60e-57040589f9ba req-99e491fc-2fc5-4a3e-aa63-882858c56d72 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:00.025610 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999717266000061 future=<Future at 0x7a464810b1d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:00.027071 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Instance destroyed successfully.
May 13 04:19:00.027673 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lazy-loading 'resources' on Instance uuid 895c0f15-772c-4b0f-a0b3-dc5469ce3508 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:00.125187 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:00.173132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.965s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:00.173132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:00.191448 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:00.192158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:00.192828 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:00.193048 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:00.193751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:00.196632 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:00.206559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:00.206559 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:00.217506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:00.217506 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:00.221121 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:00.223977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c] added
May 13 04:19:00.223977 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:00.223977 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:00.223977 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:00.223977 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:00.223977 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:00.223977 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:00.224375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:00.224375 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:00.224534 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:00.234970 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c] added
May 13 04:19:00.234970 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:00.234970 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:00.234970 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:00.234970 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:00.234970 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:00.234970 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:00.235471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:00.235471 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:00.235661 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:00.295203 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updated VIF entry in instance network info cache for port e9bf2e16-f33c-4337-bc33-e01983584e7a. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:19:00.295680 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updating instance_info_cache with network_info: [{"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:00.531966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517050181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumeshelvetestjson-server-517050181',id=27,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYmyFtnd1eLID1EsfTwvaras4CcC8UsQP9RdC13+DKK43Y/vzmRVw1KFJ0lappqbALhb4+6211tufaRF9DIVglBJNbtdud5OUZ21p/5r5kiqDkAxRjH/CBV19O8hp6hhA==',key_name='tempest-keypair-844275117',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:21Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94e441f4e3754f1692b7d4b86c603ca8',ramdisk_id='',reservation_id='r-g0080sv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-173127407',owner_user_name='tempest-AttachVolumeShelveTestJSON-173127407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2542ae398407abdb47a235f3c8505',uuid=895c0f15-772c-4b0f-a0b3-dc5469ce3508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:19:00.532199 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converting VIF {"id": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "address": "fa:16:3e:bd:76:53", "network": {"id": "79d13445-4aac-46d5-8aed-db059f920f96", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1054033065-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94e441f4e3754f1692b7d4b86c603ca8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c562a0-eb", "ovs_interfaceid": "e8c562a0-eb26-4e3a-a170-8f1da7a57976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:00.533303 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:00.533508 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:19:00.535344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.535344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c562a0-eb, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:00.535796 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.536811 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:00.539109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.539109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.539109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b1cd13-5f96-4c29-9a9a-2bdb8e56f9fd) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:00.540622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.540622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:00.540622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:00.542449 np0000000669 nova-compute[97951]: INFO os_vif [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:76:53,bridge_name='br-int',has_traffic_filtering=True,id=e8c562a0-eb26-4e3a-a170-8f1da7a57976,network=Network(79d13445-4aac-46d5-8aed-db059f920f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c562a0-eb')
May 13 04:19:00.542734 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Deleting instance files /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508_del
May 13 04:19:00.550249 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Deletion of /opt/stack/data/nova/instances/895c0f15-772c-4b0f-a0b3-dc5469ce3508_del complete
May 13 04:19:00.643679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-baf25a2d-e098-4fac-b938-d4589b010462 tempest-VolumesNegativeTest-42147450 tempest-VolumesNegativeTest-42147450-project-member] Lock "bfa2de5a-1a4c-4ef4-a2de-120966dba9eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.349s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:00.802787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-365c9c57-f585-4461-9618-127395c5d2f3 req-46b8f527-7716-40e4-87d8-5ee2b687317f service nova] Releasing lock "refresh_cache-ebcb283c-a661-421d-b276-132c83950c5a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:01.069402 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 04:19:01.070232 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:19:01.070826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:19:01.070962 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:19:01.071194 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:01.149148 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:01.225495 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:01.238024 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:01.245809 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:01.245809 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:01.256601 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:01.256601 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.272174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.283280 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.293711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.293711 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.293711 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.293711 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:01.293938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.293938 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.293938 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.293938 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:01.305207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.305207 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.305207 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.305207 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:01.305730 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.305730 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.305730 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.305730 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:01.332662 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260]
May 13 04:19:01.332662 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260] successful.
May 13 04:19:01.332662 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.348565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.357385 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260]
May 13 04:19:01.357385 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260] successful.
May 13 04:19:01.357385 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.371884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.371884 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.371884 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.371884 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.371884 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.371884 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:01.372210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.372210 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.372210 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.372210 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.372210 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.372210 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:01.372434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:01.372434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:01.373221 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] HCTL ('8', '-', '-', 0) found on session 76 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:01.373538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:01.380800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:01.400076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching for a device in session 76 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:01.400260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:01.407840 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.407840 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.407840 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.407840 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.407840 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.407840 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:01.408608 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:01.408608 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:01.409921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:01.410572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] HCTL ('9', '-', '-', 0) found on session 77 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:01.410720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:01.437254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Searching for a device in session 77 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:01.437254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:01.838833 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6890de1-273d-4a6e-bf9d-911296cd7672 req-266b7d83-c5f3-44a4-85fc-551423d3d954 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-deleted-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:01.839201 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c6890de1-273d-4a6e-bf9d-911296cd7672 req-266b7d83-c5f3-44a4-85fc-551423d3d954 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Neutron deleted interface e8c562a0-eb26-4e3a-a170-8f1da7a57976; detaching it from the instance and deleting it from the info cache
May 13 04:19:01.839309 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c6890de1-273d-4a6e-bf9d-911296cd7672 req-266b7d83-c5f3-44a4-85fc-551423d3d954 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:01.992301 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:01.993018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] Acquiring lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:01.993788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:01.995247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:01.995955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] No waiting events found dispatching network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:01.996684 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-362aee6d-6db2-4da4-a802-5033e70774ad req-43ade59c-16ad-422f-897e-620a5fb3cbdb service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Received event network-vif-unplugged-e8c562a0-eb26-4e3a-a170-8f1da7a57976 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:02.194190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:19:02.281140 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:02.345350 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6890de1-273d-4a6e-bf9d-911296cd7672 req-266b7d83-c5f3-44a4-85fc-551423d3d954 service nova] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Detach interface failed, port_id=e8c562a0-eb26-4e3a-a170-8f1da7a57976, reason: Instance 895c0f15-772c-4b0f-a0b3-dc5469ce3508 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:19:02.430762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:02.431284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:02.783304 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Took 1.71 seconds to deallocate network for instance.
May 13 04:19:02.935409 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lazy-loading 'flavor' on Instance uuid 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:02.975179 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0007394990000193502 future=<Future at 0x7a463c187800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:02.975710 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Emitting event <LifecycleEvent: 1778645927.9743638, c6db6f9c-40f7-4d97-ab8b-46efcb89223d => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:02.975923 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:02.976054 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] VM Stopped (Lifecycle Event)
May 13 04:19:02.977208 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.167661850000059 future=<Future at 0x7a46481ebcb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:02.977208 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.167545049000182 future=<Future at 0x7a46481ebcb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:03.213267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Found WWN 3300000008864b09c for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:19:03.214864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:03.215884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== connect_volume: return (5008ms) {'type': 'block', 'scsi_wwn': '3300000008864b09c', 'path': '/dev/dm-0', 'multipath_id': '3300000008864b09c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:03.217163 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008864b09c', 'path': '/dev/dm-0', 'multipath_id': '3300000008864b09c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:19:03.288303 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:03.288698 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:03.480837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: c6db6f9c-40f7-4d97-ab8b-46efcb89223d] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:03.636679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:03.636879 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:03.734136 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-845771767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:02Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:19:03.734293 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:03.737863 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:03.743863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] End _get_guest_xml xml=<domain type="qemu">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <uuid>b6e65a61-0ae4-402c-9138-cef6ac3ae614</uuid>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <name>instance-0000001f</name>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServerActionsV293TestJSON-server-845771767</nova:name>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:18:57</nova:creationTime>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:image uuid="592e03e6-ecc4-4529-9aa6-c500693e9d97">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:user uuid="60d575550f71492580f700f334bc84b0">tempest-ServerActionsV293TestJSON-1586826136-project-member</nova:user>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:project uuid="cbf2cd35b50144e09a9d2fa69360c9f6">tempest-ServerActionsV293TestJSON-1586826136</nova:project>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid="592e03e6-ecc4-4529-9aa6-c500693e9d97"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         <nova:port uuid="c5028e97-a0d6-4813-a661-dc6aec89dfbc">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <system>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="serial">b6e65a61-0ae4-402c-9138-cef6ac3ae614</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="uuid">b6e65a61-0ae4-402c-9138-cef6ac3ae614</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </system>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <os>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </os>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <features>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </features>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   <devices>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <alias name="ua-b5ff2a40-effd-4a6f-837c-4809bb8c128c"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <serial>b5ff2a40-effd-4a6f-837c-4809bb8c128c</serial>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:10:60:b5"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <target dev="tapc5028e97-a0"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </interface>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/console.log" append="off"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </serial>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <video>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </video>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </rng>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:   </devices>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]: </domain>
May 13 04:19:03.743863 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:19:03.746868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-845771767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:02Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:19:03.747517 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:03.747593 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:03.747761 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:19:03.749469 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.749673 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:03.750111 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:19:03.752112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.752445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e208754-86b9-56d6-b715-37b8263a3abd', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:03.753128 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.754501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.761527 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.761779 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5028e97-a0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:03.762138 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5028e97-a0, col_values=(('qos', UUID('d5244931-13d0-4f7e-a252-397014632f96')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:03.762300 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5028e97-a0, col_values=(('external_ids', {'iface-id': 'c5028e97-a0d6-4813-a661-dc6aec89dfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:60:b5', 'vm-uuid': 'b6e65a61-0ae4-402c-9138-cef6ac3ae614'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:03.763092 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.764349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:03.769517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:03.770556 np0000000669 nova-compute[97951]: INFO os_vif [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0')
May 13 04:19:03.941946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:04.139269 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:04.645627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.357s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:04.659054 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:04.701801 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Deleted allocations for instance 895c0f15-772c-4b0f-a0b3-dc5469ce3508
May 13 04:19:05.134648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:05.134648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:05.134648 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Attaching volume 03f99fff-f56f-4bb2-8675-e01a79e0aca9 to /dev/vdb
May 13 04:19:05.172413 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:05.184278 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:19:05.211789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:05.259000 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:19:05.260954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:19:05.272343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:19:05.273606 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed8:8fa1', 'fe80::44c4:37ff:fec4:9a06', 'fe80::fc16:3eff:fea1:ebfc', 'fe80::3888:77ff:fecf:8e8a', 'fe80::fc16:3eff:fe8e:9753', 'fe80::b4ff:dbff:fee0:96cd'] 
May 13 04:19:05.273933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:19:05.274123 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:19:05.274487 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:05.274767 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating existing volume attachment record: ff2524a8-1203-45f6-b3c8-4c9549288e34 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:19:05.308052 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:05.308199 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:05.308352 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] No VIF found with MAC fa:16:3e:10:60:b5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:19:05.309038 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Using config drive
May 13 04:19:05.712145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3e5298b3-96c0-40bd-951a-aae0993f3fea tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Lock "895c0f15-772c-4b0f-a0b3-dc5469ce3508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.561s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:05.816137 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lazy-loading 'ec2_ids' on Instance uuid b6e65a61-0ae4-402c-9138-cef6ac3ae614 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:05.850241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:19:05.850574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:05.850714 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:05.851118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:05.851286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:05.867030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:05.867779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:05.868459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:05.868459 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:05.868587 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:05.868805 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:05.886158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:05.886158 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:05.891246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:05.891246 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9] added
May 13 04:19:05.899931 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:05.899931 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:05.899931 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:05.902812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9] added
May 13 04:19:05.902812 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:05.902812 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:05.902812 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:05.902812 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:05.902812 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:05.902812 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:05.903088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:05.903088 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:05.903236 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:06.324821 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Object Instance<b6e65a61-0ae4-402c-9138-cef6ac3ae614> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:19:06.325894 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lazy-loading 'keypairs' on Instance uuid b6e65a61-0ae4-402c-9138-cef6ac3ae614 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:06.833174 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Object Instance<b6e65a61-0ae4-402c-9138-cef6ac3ae614> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:19:06.837436 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 13 04:19:06.901016 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:06.903644 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:06.917593 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:06.917593 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:06.927164 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:06.927164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:06.936943 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:06.948134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.956216 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:06.970868 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:07.002412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.40.100,3260]
May 13 04:19:07.002412 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.40.100,3260] successful.
May 13 04:19:07.002412 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:07.012610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.50.100,3260]
May 13 04:19:07.012610 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.50.100,3260] successful.
May 13 04:19:07.012610 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:07.017751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:07.025937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.040076 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.040494 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:07.040812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:07.040812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:07.041867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] HCTL ('10', '-', '-', 0) found on session 78 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:07.042040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.051863 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-025f44fd-3364-4667-b95e-830edb9f0997 (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:07.052181 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:07.052446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:07.052570 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:07.053489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] HCTL ('11', '-', '-', 0) found on session 79 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:07.053627 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:07.062940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Searching for a device in session 78 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:07.062940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:07.068442 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Creating config drive at /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config
May 13 04:19:07.073890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqedg81k0 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:07.092395 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Searching for a device in session 79 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:07.092688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:07.146733 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqedg81k0" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:19:07.593356 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:07.621903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:07.627627 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:07.743112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:07.834224 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:07.834224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:07.834224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:07.834224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:07.835310 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:07.835310 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ab508011-8477-435b-99f5-447afe95d94a req-2013ab01-939f-47af-beb6-c9cdd8c7066c service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received unexpected event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with vm_state active and task_state rebuild_spawning.
May 13 04:19:07.868406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:19:08.006193 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.007910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.011445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.012962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.036432 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.626642 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645948.625945, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:08.626642 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Resumed (Lifecycle Event)
May 13 04:19:08.628257 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:19:08.628443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:19:08.632869 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance spawned successfully.
May 13 04:19:08.633248 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:19:08.773460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:08.886677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Found WWN 330000000dd6b5bff for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:19:08.887199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:08.887232 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000dd6b5bff', 'path': '/dev/dm-3', 'multipath_id': '330000000dd6b5bff'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:08.887433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd6b5bff', 'path': '/dev/dm-3', 'multipath_id': '330000000dd6b5bff'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:19:08.897440 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lazy-loading 'flavor' on Instance uuid 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:09.130619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:09.133976 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:19:09.144559 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.144679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.145024 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.145274 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.145545 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.145809 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:09.402076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Attempting to attach volume 03f99fff-f56f-4bb2-8675-e01a79e0aca9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:19:09.404617 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:   <alias name="ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9"/>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:   <serial>03f99fff-f56f-4bb2-8675-e01a79e0aca9</serial>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:09.404617 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:19:09.638116 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 13 04:19:09.638238 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645949.638015, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:09.638406 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Started (Lifecycle Event)
May 13 04:19:09.661547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:09.662739 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:09.929577 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:09.932913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:09.933119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:09.933286 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:09.935750 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:09.938675 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-876a4390-2947-4fb1-ab84-3ddf70f93bfd req-cbf42a81-256d-439e-9d17-78e67f304d2b service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received unexpected event network-vif-plugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with vm_state active and task_state None.
May 13 04:19:10.145721 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:10.150807 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:19:10.177730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:10.178601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:10.179469 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97951) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 13 04:19:11.108642 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:11.109107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:11.109107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:11.109107 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] No VIF found with MAC fa:16:3e:d8:8f:a1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:19:11.127714 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:11.195845 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d75cdbb0-a44c-4554-9840-145b85555876 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.017s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:12.145231 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004220129999339406 future=<Future at 0x7a46481ebcb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:12.145794 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:12.145794 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.879817600000024 future=<Future at 0x7a464810b1d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:12.145794 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.8797403340001893 future=<Future at 0x7a464810b1d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:12.146001 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Emitting event <LifecycleEvent: 1778645937.1446817, bfa2de5a-1a4c-4ef4-a2de-120966dba9eb => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:12.146178 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] VM Stopped (Lifecycle Event)
May 13 04:19:12.653348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8151684e-196f-4390-8d12-9411e14ba53e tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: bfa2de5a-1a4c-4ef4-a2de-120966dba9eb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:12.676847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77df2b7a-365e-425f-9fc5-4b7fa3e58c20 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.542s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:13.775531 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:14.198358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:14.198535 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:14.662758 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:14.708641 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Detaching volume 03f99fff-f56f-4bb2-8675-e01a79e0aca9
May 13 04:19:14.761840 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Attempting to driver detach volume 03f99fff-f56f-4bb2-8675-e01a79e0aca9 from mountpoint /dev/vdb
May 13 04:19:14.771194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Found disk vdb by alias ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:14.771194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Found disk vdb by alias ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:14.771194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Attempting to detach device vdb from instance 2c3c381e-5a15-4198-afb9-388efefee7bf from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:19:14.771355 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <alias name="ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9"/>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <serial>03f99fff-f56f-4bb2-8675-e01a79e0aca9</serial>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:14.771355 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:14.784649 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Successfully detached device vdb from instance 2c3c381e-5a15-4198-afb9-388efefee7bf from the persistent domain config.
May 13 04:19:14.784649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] (1/8): Attempting to detach device vdb with device alias ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9 from instance 2c3c381e-5a15-4198-afb9-388efefee7bf from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:19:14.784649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <alias name="ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9"/>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <serial>03f99fff-f56f-4bb2-8675-e01a79e0aca9</serial>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:14.784649 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:15.026447 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00037840199979655154 future=<Future at 0x7a464810b1d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:15.026582 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:15.026937 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645940.0251727, 895c0f15-772c-4b0f-a0b3-dc5469ce3508 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:15.027213 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] VM Stopped (Lifecycle Event)
May 13 04:19:15.319411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645955.3190746, 2c3c381e-5a15-4198-afb9-388efefee7bf => ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:19:15.320920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03f99fff-f56f-4bb2-8675-e01a79e0aca9 for instance 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:19:15.323101 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Successfully detached device vdb from instance 2c3c381e-5a15-4198-afb9-388efefee7bf from the live domain config.
May 13 04:19:15.324227 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:19:15.324562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:15.324769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:15.325201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:15.325718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03f99fff-f56f-4bb2-8675-e01a79e0aca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:19:15.325966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:15.351245 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9 (non-flash)
May 13 04:19:15.351534 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:15.351660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', '79')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:19:15.351782 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', '78')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:15.353345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9', '79')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:15.354364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648129a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:19:15.354939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Removing multipathed devices sdf, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:19:15.355271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Flush multipath device 330000000dd6b5bff {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:19:15.391712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:15.442816 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:15.476004 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:15.477763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:15.487056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:19:15.487236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:19:15.488164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:19:15.502649 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:19:15.502819 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:19:15.512493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.530110 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 895c0f15-772c-4b0f-a0b3-dc5469ce3508] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:15.545005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.40.100,3260]
May 13 04:19:15.545005 np0000000669 nova-compute[97951]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.40.100,3260] successful.
May 13 04:19:15.545005 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.565257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.576486 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.617867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.50.100,3260]
May 13 04:19:15.617867 np0000000669 nova-compute[97951]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-03f99fff-f56f-4bb2-8675-e01a79e0aca9, portal: 192.168.50.100,3260] successful.
May 13 04:19:15.617867 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.632115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:15.632555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:15.632555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] <== disconnect_volume: return (307ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:15.632555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:19:15.982705 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Detaching volume 203fccaa-ad18-4bee-8e22-bbdd75ba3d2a
May 13 04:19:16.027147 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Attempting to driver detach volume 203fccaa-ad18-4bee-8e22-bbdd75ba3d2a from mountpoint /dev/vdb
May 13 04:19:16.037729 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Found disk vdb by alias ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:16.039994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Found disk vdb by alias ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:16.039994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Attempting to detach device vdb from instance a26ca192-6544-4d60-b566-17ee3d91bff7 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:19:16.039994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <alias name="ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a"/>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <serial>203fccaa-ad18-4bee-8e22-bbdd75ba3d2a</serial>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:16.039994 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:16.049650 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Successfully detached device vdb from instance a26ca192-6544-4d60-b566-17ee3d91bff7 from the persistent domain config.
May 13 04:19:16.049650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] (1/8): Attempting to detach device vdb with device alias ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a from instance a26ca192-6544-4d60-b566-17ee3d91bff7 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:19:16.049650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <alias name="ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a"/>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-4"/>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <serial>203fccaa-ad18-4bee-8e22-bbdd75ba3d2a</serial>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:16.049650 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:16.181507 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lazy-loading 'flavor' on Instance uuid 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:16.600946 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645956.6006095, a26ca192-6544-4d60-b566-17ee3d91bff7 => ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:19:16.602643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a for instance a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:19:16.605231 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Successfully detached device vdb from instance a26ca192-6544-4d60-b566-17ee3d91bff7 from the live domain config.
May 13 04:19:16.609009 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:19:16.609272 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:16.609460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:16.609702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:16.609952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:19:16.610075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:19:16.631750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:16.631750 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:16.631750 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:16.631750 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:16.631750 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:16.632105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsi session list stdout=tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:16.632105 np0000000669 nova-compute[97951]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a (non-flash)
May 13 04:19:16.632105 np0000000669 nova-compute[97951]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:16.632105 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:16.632105 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:16.632281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '77')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:19:16.632384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '69')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:16.633193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a', '68')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:16.633975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648217740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:19:16.634187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Removing multipathed devices sdh, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:19:16.634439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Flush multipath device 330000000dab73fc6 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:19:16.672306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:16.725802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:16.791312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:19:16.791460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:19:16.792748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:19:16.807807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:19:16.808105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:19:16.822746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.860768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.40.100,3260]
May 13 04:19:16.860768 np0000000669 nova-compute[97951]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.40.100,3260] successful.
May 13 04:19:16.860768 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.873686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.887508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.926208 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.50.100,3260]
May 13 04:19:16.926208 np0000000669 nova-compute[97951]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-203fccaa-ad18-4bee-8e22-bbdd75ba3d2a, portal: 192.168.50.100,3260] successful.
May 13 04:19:16.926208 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.943183 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:16.943229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:16.943367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] <== disconnect_volume: return (333ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:16.943523 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:19:17.191830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-797a9f16-ae06-4ac4-9fd0-bc98132aa935 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.993s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:17.496474 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'flavor' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:17.841009 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:18.502949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-27a80972-3e27-4034-8f91-dd18293e134d tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.026s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:18.670818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:18.670818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:18.670818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:18.670818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:18.670818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:18.671837 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Terminating instance
May 13 04:19:18.775774 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.085344 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:19.085548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 04:19:19.174902 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:19:19.197108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.205956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.214907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:19.215108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:19.215284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:19.215448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:19.215587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:19.218034 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Terminating instance
May 13 04:19:19.229382 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.239393 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.261611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.267888 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.461576 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:19.461862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:19.461919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:19.462047 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:19.463047 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] No waiting events found dispatching network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:19.463450 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b17e13a1-4cf6-4da1-9ada-7975c4d0da06 req-2d5588cb-08bc-4daf-b106-764d6da1e043 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:19.519563 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999725302000115 future=<Future at 0x7a463c7b2e70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:19.522261 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99719415300001 future=<Future at 0x7a463c7b2e70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:19.522261 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99700610800005 future=<Future at 0x7a463c7b2e70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:19.523277 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Instance destroyed successfully.
May 13 04:19:19.523946 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lazy-loading 'resources' on Instance uuid 2c3c381e-5a15-4198-afb9-388efefee7bf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:19.589819 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:19.664963 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.722703 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:19:19.749628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.772066 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.784784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:19.817104 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.029386 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-856604247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachscenariooldversion-server-8566042',id=32,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX9VOAeMsUrS7RTXQkdLQpFtDYPQYrtoYjYt9xH8nmVjfrnqPX+/tGdEn2F4c7nyP6TfIjGSNHr8Rh3oO5fTE+eOsB/38iOGLrdXLcnztrVr96vgvCiJpUdKqkssjyx+w==',key_name='tempest-keypair-1992566784',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:22Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2e949cc9fb441d4af79255215405cc3',ramdisk_id='',reservation_id='r-5lovhedg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd7d5914f54b4045b7ba7edb97613086',uuid=2c3c381e-5a15-4198-afb9-388efefee7bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:19:20.029386 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converting VIF {"id": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "address": "fa:16:3e:d8:8f:a1", "network": {"id": "69a48fdb-9c06-479c-bd04-c046a0eeb036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2114216490-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2e949cc9fb441d4af79255215405cc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap161fcf3d-df", "ovs_interfaceid": "161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:20.029658 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:20.029924 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:19:20.031441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.031663 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap161fcf3d-df, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:20.033812 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.034963 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:20.045269 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999660819999917 future=<Future at 0x7a463c1849b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:20.045561 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Instance destroyed successfully.
May 13 04:19:20.045934 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lazy-loading 'resources' on Instance uuid a26ca192-6544-4d60-b566-17ee3d91bff7 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:20.047455 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.050441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.050441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d79818f4-b598-4265-9edc-3f2b6a0531e3) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:20.050441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.050441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:20.056067 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.058053 np0000000669 nova-compute[97951]: INFO os_vif [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8f:a1,bridge_name='br-int',has_traffic_filtering=True,id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7,network=Network(69a48fdb-9c06-479c-bd04-c046a0eeb036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161fcf3d-df')
May 13 04:19:20.058714 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Deleting instance files /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf_del
May 13 04:19:20.059646 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Deletion of /opt/stack/data/nova/instances/2c3c381e-5a15-4198-afb9-388efefee7bf_del complete
May 13 04:19:20.094773 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:19:20.248781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.549422 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-549655183',display_name='tempest-ServerStableDeviceRescueTest-server-549655183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serverstabledevicerescuetest-server-549655183',id=28,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgGn+ovjMLs5pEgOfAzTUALf/n8SK8axWsTN6Ncx3rTPNBqiUZTcgp6rhT6ZtmtGrKZu5xErsOEsk9yIO1jWkY8+BJTsq5AcaMnENkInWTjD09DKcS4QrGSFGvE+Q4OYQ==',key_name='tempest-keypair-1545026129',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:37Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3b639861ec44659ada64bddafc7172d',ramdisk_id='',reservation_id='r-penoq4kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1671909926',owner_user_name='tempest-ServerStableDeviceRescueTest-1671909926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a537cfdbd3cb43b885ae21a9db152e57',uuid=a26ca192-6544-4d60-b566-17ee3d91bff7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:19:20.550120 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converting VIF {"id": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "address": "fa:16:3e:a1:eb:fc", "network": {"id": "8ada22ce-e5ca-4d28-9bd6-ed92f00af322", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43167468-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b639861ec44659ada64bddafc7172d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2999b0b3-03", "ovs_interfaceid": "2999b0b3-03bf-4a9d-b6c5-0598f57f69ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:20.550220 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:20.550814 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:19:20.552613 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.553441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2999b0b3-03, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:20.553959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.554837 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:20.555561 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.555715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d74fc1b0-4fbd-4ecc-94c9-182c89f0c106) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:20.556147 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.556714 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:20.557467 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:20.559752 np0000000669 nova-compute[97951]: INFO os_vif [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:eb:fc,bridge_name='br-int',has_traffic_filtering=True,id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee,network=Network(8ada22ce-e5ca-4d28-9bd6-ed92f00af322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2999b0b3-03')
May 13 04:19:20.560010 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Deleting instance files /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7_del
May 13 04:19:20.560802 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Deletion of /opt/stack/data/nova/instances/a26ca192-6544-4d60-b566-17ee3d91bff7_del complete
May 13 04:19:20.572827 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:19:20.573434 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:19:20.574729 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:19:20.575178 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:19:20.575244 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:20.699138 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:21.076371 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Took 1.35 seconds to destroy the instance on the hypervisor.
May 13 04:19:21.078391 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:19:21.078639 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:19:21.078702 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:19:21.082297 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:21.212840 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:21.566756 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:21.567255 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] Acquiring lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:21.567374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:21.567577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:21.567724 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] No waiting events found dispatching network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:21.567803 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-unplugged-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:21.567893 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Received event network-vif-deleted-161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:21.568064 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Neutron deleted interface 161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7; detaching it from the instance and deleting it from the info cache
May 13 04:19:21.568233 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:21.750455 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c68cf2e5-52dd-444d-a0d2-76bc092d96a3 req-c886d9b3-85ba-4651-a5ed-0266d344fda1 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Received event network-vif-deleted-2999b0b3-03bf-4a9d-b6c5-0598f57f69ee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:21.750769 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c68cf2e5-52dd-444d-a0d2-76bc092d96a3 req-c886d9b3-85ba-4651-a5ed-0266d344fda1 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Neutron deleted interface 2999b0b3-03bf-4a9d-b6c5-0598f57f69ee; detaching it from the instance and deleting it from the info cache
May 13 04:19:21.750769 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c68cf2e5-52dd-444d-a0d2-76bc092d96a3 req-c886d9b3-85ba-4651-a5ed-0266d344fda1 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:21.757988 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:22.073820 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a44d97-db85-4b17-a227-89c0e04642c7 req-2760c238-5d2a-448b-ab2a-60ee7ee85774 service nova] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Detach interface failed, port_id=161fcf3d-dfd0-42d1-a93c-d62ab96d4ca7, reason: Instance 2c3c381e-5a15-4198-afb9-388efefee7bf could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:19:22.093390 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:22.093711 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:22.093900 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:22.187195 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:22.255852 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c68cf2e5-52dd-444d-a0d2-76bc092d96a3 req-c886d9b3-85ba-4651-a5ed-0266d344fda1 service nova] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Detach interface failed, port_id=2999b0b3-03bf-4a9d-b6c5-0598f57f69ee, reason: Instance a26ca192-6544-4d60-b566-17ee3d91bff7 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:19:22.261210 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Took 1.69 seconds to deallocate network for instance.
May 13 04:19:22.600388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:22.600388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:22.600388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:22.600388 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:19:22.691986 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Took 1.61 seconds to deallocate network for instance.
May 13 04:19:22.767834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:22.767834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:23.043499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:23.044330 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:23.199092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:23.546875 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:23.641614 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:19:23.642873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:23.747924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:19:23.748514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:23.859750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:19:23.863642 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:19:23.865493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:23.932034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.066s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:19:23.932579 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13490MB free_disk=73.1769905090332GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:19:23.932803 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:23.983310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:24.055709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.288s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:24.059756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.861s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:24.139821 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Deleted allocations for instance 2c3c381e-5a15-4198-afb9-388efefee7bf
May 13 04:19:24.339441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:24.339441 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:24.668633 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:24.843437 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:25.152143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51788bf3-09cc-455b-9249-6ce232306404 tempest-TestServerVolumeAttachScenarioOldVersion-327147590 tempest-TestServerVolumeAttachScenarioOldVersion-327147590-project-member] Lock "2c3c381e-5a15-4198-afb9-388efefee7bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.482s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:25.353463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.292s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:25.354056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.421s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:25.448573 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Deleted allocations for instance a26ca192-6544-4d60-b566-17ee3d91bff7
May 13 04:19:25.559086 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:26.379947 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:26.432720 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance b6e65a61-0ae4-402c-9138-cef6ac3ae614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:19:26.432720 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance ebcb283c-a661-421d-b276-132c83950c5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:19:26.432720 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:19:26.432720 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:19:23 up 33 min,  2 users,  load average: 8.68, 7.52, 4.21\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_4c06d9163829483dafb7a6dcd1a3f194': '1', 'io_workload': '0', 'num_proj_cbf2cd35b50144e09a9d2fa69360c9f6': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:19:26.456763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2c3b8a5-7fda-4d14-89c5-ca47ee8f6a3a tempest-ServerStableDeviceRescueTest-1671909926 tempest-ServerStableDeviceRescueTest-1671909926-project-member] Lock "a26ca192-6544-4d60-b566-17ee3d91bff7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.242s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:26.623771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:26.623999 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:26.741967 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:27.890175 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:27.890175 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:19:27.890175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.291s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:27.890175 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:27.890175 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 04:19:28.147858 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] There are 0 instances to clean {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 04:19:28.148225 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.98 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:19:28.335106 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:29.133878 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.134505 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.134505 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.134505 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.134902 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.135103 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:29.135225 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:19:29.135749 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 27.45 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:19:29.668847 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:30.563278 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:30.988482 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:31.065248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:34.519927 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004303089999666554 future=<Future at 0x7a463c7b2e70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:34.519927 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:34.519927 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.5241921949998414 future=<Future at 0x7a463c1849b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:34.519927 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.5241280139998707 future=<Future at 0x7a463c1849b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:34.520907 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778645959.5191896, 2c3c381e-5a15-4198-afb9-388efefee7bf => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:34.521117 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] VM Stopped (Lifecycle Event)
May 13 04:19:34.671014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:35.026407 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 2c3c381e-5a15-4198-afb9-388efefee7bf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:35.044438 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00033449400007157237 future=<Future at 0x7a463c1849b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:35.044983 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:35.047001 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] Emitting event <LifecycleEvent: 1778645960.0440044, a26ca192-6544-4d60-b566-17ee3d91bff7 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:35.047245 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] VM Stopped (Lifecycle Event)
May 13 04:19:35.550314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2d97bb0f-200c-4dc9-929b-6d3ae57e8118 tempest-AttachVolumeShelveTestJSON-173127407 tempest-AttachVolumeShelveTestJSON-173127407-project-member] [instance: a26ca192-6544-4d60-b566-17ee3d91bff7] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:35.567412 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:35.629235 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:35.629769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:35.747314 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:35.907577 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:36.133103 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:37.138525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:38.010759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:38.255561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:38.256038 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:38.256038 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Attaching volume 0dd50329-397b-45fe-a242-43ff0a3de9ab to /dev/vdb
May 13 04:19:38.305567 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:38.317873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:19:38.340806 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:38.392268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:19:38.392654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:19:38.405715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:19:38.406948 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe8e:9753', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe10:60b5', 'fe80::10fa:20ff:fe53:97e4'] 
May 13 04:19:38.408350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:19:38.408350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:19:38.408350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:38.408350 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updating existing volume attachment record: 14d81649-3662-4903-8efd-13976f1f1b93 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:19:38.798359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:38.984140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:19:38.984559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:38.984752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:38.985273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:38.985845 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:39.004237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:39.007440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:39.007440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:39.007440 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:39.007440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:39.007705 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:39.023484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:39.023484 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:39.032619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:39.032619 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab] added
May 13 04:19:39.041248 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:39.041248 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:39.041248 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:39.041566 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab] added
May 13 04:19:39.045244 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:39.045244 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:39.045244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:39.045583 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:39.045634 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:39.673596 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:40.042947 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:40.046188 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:40.058671 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:40.058671 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:40.063972 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:40.063972 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.074707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.080700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.087235 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:19:40.091527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.091527 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.091527 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.091527 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.091527 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.091527 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:40.091780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.091780 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.091780 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.091780 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.091780 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.091780 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:40.099630 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.099630 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.099630 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.099630 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.099630 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.099630 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:40.099948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.099948 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.099948 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.099948 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.099948 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.099948 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:40.142105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.40.100,3260]
May 13 04:19:40.142105 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.40.100,3260] successful.
May 13 04:19:40.142105 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.159236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.175158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.50.100,3260]
May 13 04:19:40.175158 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.50.100,3260] successful.
May 13 04:19:40.175158 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.182548 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.182857 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:40.183052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:40.183425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:40.184202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('12', '-', '-', 0) found on session 84 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:40.187718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:40.190667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:40.202852 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 84 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:40.203077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.211843 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:40.212118 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:40.212375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:40.212375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:40.214979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('13', '-', '-', 0) found on session 85 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:40.214979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:40.234744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 85 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:40.234744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:40.567686 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:41.008790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:19:42.027398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found WWN 33000000043c2871e for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:19:42.027768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:42.027768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '33000000043c2871e', 'path': '/dev/dm-6', 'multipath_id': '33000000043c2871e'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:42.027964 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000043c2871e', 'path': '/dev/dm-6', 'multipath_id': '33000000043c2871e'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:19:42.033532 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:42.096408 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:42.304101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:42.304385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:42.537249 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Attempting to attach volume 0dd50329-397b-45fe-a242-43ff0a3de9ab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:19:42.538600 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:   <alias name="ua-0dd50329-397b-45fe-a242-43ff0a3de9ab"/>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:   <serial>0dd50329-397b-45fe-a242-43ff0a3de9ab</serial>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:42.538600 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:19:42.809469 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:19:43.527958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:43.528334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:43.532509 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:19:43.532666 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Claim successful on node np0000000669
May 13 04:19:43.936172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:44.237758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:44.237880 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:44.237978 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:44.238077 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:8e:97:53, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:19:44.622498 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Refreshing inventories for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 04:19:44.677215 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Updating ProviderTree inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 04:19:44.677440 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:19:44.680665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:44.723491 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Refreshing aggregate associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, aggregates: None {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 04:19:44.789513 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Refreshing trait associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_ICH9,HW_ARCH_X86_64,HW_CPU_X86_SSE,COMPUTE_ARCH_X86_64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ARCH_PPC64LE,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 04:19:45.021215 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:45.021595 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:45.524606 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:45.567968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:45.790464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d92dd199-5dbb-469f-9dde-aa832dc339bf tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.535s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:46.033535 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.503s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:46.033535 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:19:46.334633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:46.334972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:46.539462 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:19:46.539696 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:19:46.540064 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:46.543081 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:46.554641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:46.554876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:46.658351 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:19:46.838708 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Detaching volume 0dd50329-397b-45fe-a242-43ff0a3de9ab
May 13 04:19:46.893497 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Attempting to driver detach volume 0dd50329-397b-45fe-a242-43ff0a3de9ab from mountpoint /dev/vdb
May 13 04:19:46.901543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-0dd50329-397b-45fe-a242-43ff0a3de9ab {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:46.902741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-0dd50329-397b-45fe-a242-43ff0a3de9ab {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:19:46.902896 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Attempting to detach device vdb from instance ebcb283c-a661-421d-b276-132c83950c5a from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:19:46.903419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <alias name="ua-0dd50329-397b-45fe-a242-43ff0a3de9ab"/>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <serial>0dd50329-397b-45fe-a242-43ff0a3de9ab</serial>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:46.903419 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:46.920004 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance ebcb283c-a661-421d-b276-132c83950c5a from the persistent domain config.
May 13 04:19:46.920004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] (1/8): Attempting to detach device vdb with device alias ua-0dd50329-397b-45fe-a242-43ff0a3de9ab from instance ebcb283c-a661-421d-b276-132c83950c5a from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:19:46.920349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <alias name="ua-0dd50329-397b-45fe-a242-43ff0a3de9ab"/>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <serial>0dd50329-397b-45fe-a242-43ff0a3de9ab</serial>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]: </disk>
May 13 04:19:46.920349 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:19:47.054704 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:19:47.057635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:19:47.080820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:47.081115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:47.264528 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Successfully created port: 63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:19:47.564093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:19:47.590845 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:19:47.640884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:47.640884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:47.655422 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:19:47.655617 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Claim successful on node np0000000669
May 13 04:19:47.669200 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778645987.6686587, ebcb283c-a661-421d-b276-132c83950c5a => ua-0dd50329-397b-45fe-a242-43ff0a3de9ab> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:19:47.671072 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0dd50329-397b-45fe-a242-43ff0a3de9ab for instance ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:19:47.675925 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance ebcb283c-a661-421d-b276-132c83950c5a from the live domain config.
May 13 04:19:47.677148 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:19:47.677514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:47.677712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:47.678095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:47.678903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0dd50329-397b-45fe-a242-43ff0a3de9ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:19:47.678903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:47.723493 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:47.723827 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:47.723827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3', '86')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:19:47.724114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', '84')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:47.726131 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab', '85')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:47.728944 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b6a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'): ({'sdh'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:19:47.729297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Removing multipathed devices sdh, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:19:47.729599 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flush multipath device 33000000043c2871e {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:19:47.772500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:47.825933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:47.864406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:47.864812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:47.864923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:47.865105 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:47.865304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:47.867833 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Terminating instance
May 13 04:19:47.883066 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:19:47.883620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:19:47.885109 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:19:47.899779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:19:47.899779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:19:47.915538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:47.948800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.40.100,3260]
May 13 04:19:47.948800 np0000000669 nova-compute[97951]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.40.100,3260] successful.
May 13 04:19:47.948800 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:47.971360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:47.980364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:48.011923 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.50.100,3260]
May 13 04:19:48.011923 np0000000669 nova-compute[97951]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-0dd50329-397b-45fe-a242-43ff0a3de9ab, portal: 192.168.50.100,3260] successful.
May 13 04:19:48.011923 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:48.029009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:48.029243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:48.029405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== disconnect_volume: return (351ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:48.029623 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:19:48.066835 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Successfully updated port: 63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:19:48.071858 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Booting with volume 2aa4a007-f72e-4014-913c-ea798a6792db at /dev/vda
May 13 04:19:48.132139 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:48.132528 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-changed-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:48.132624 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Refreshing instance network info cache due to event network-changed-63301e2e-3bf0-4642-a9ba-fc3fd73e5086. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:19:48.132844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] Acquiring lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:48.133376 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] Acquired lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:48.133376 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Refreshing network info cache for port 63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:19:48.152451 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:19:48.167964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:48.178889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:48.231522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:19:48.232289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:19:48.242560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:19:48.243458 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe8e:9753', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe10:60b5', 'fe80::10fa:20ff:fe53:97e4'] 
May 13 04:19:48.243567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:19:48.244108 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:19:48.244108 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:48.244265 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Updating existing volume attachment record: d2fe585b-116b-4006-8079-3f52833a183f {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:19:48.371679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:19:48.415734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.415734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.436532 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.442429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.466861 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.473624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:48.570240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:48.595479 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:48.641976 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:48.723874 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999633700000004 future=<Future at 0x7a463c107ce0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:48.724967 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.9985318680001 future=<Future at 0x7a463c107ce0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:48.725076 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99838247699995 future=<Future at 0x7a463c107ce0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:48.726333 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Instance destroyed successfully.
May 13 04:19:48.727026 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lazy-loading 'resources' on Instance uuid b6e65a61-0ae4-402c-9138-cef6ac3ae614 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:48.774785 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:49.019800 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:49.068075 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:49.068438 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:49.233226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-845771767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serveractionsv293testjson-server-373649676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38/kEO9ejLHq/T7j/6zcJlI+i8A4nP6vxHiAGKnm6LM4cxU9oIJAy8FHyL/7ltMPsZN6YQGWwk+/90ZTC4/ZjbiXYskozrl8Dg0aXrIdbUMTNJSSiEPVErZMgQb1g5+w==',key_name='tempest-keypair-1315444389',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:19:09Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbf2cd35b50144e09a9d2fa69360c9f6',ramdisk_id='',reservation_id='r-uo0uf1k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='592e03e6-ecc4-4529-9aa6-c500693e9d97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1586826136',owner_user_name='tempest-ServerActionsV293TestJSON-1586826136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d575550f71492580f700f334bc84b0',uuid=b6e65a61-0ae4-402c-9138-cef6ac3ae614,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:19:49.233226 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converting VIF {"id": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "address": "fa:16:3e:10:60:b5", "network": {"id": "a2943c12-dc01-4ff3-8292-a5a2912eea17", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-306173342-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbf2cd35b50144e09a9d2fa69360c9f6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5028e97-a0", "ovs_interfaceid": "c5028e97-a0d6-4813-a661-dc6aec89dfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:49.233226 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:49.233226 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:19:49.233610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:49.233610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5028e97-a0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:49.243561 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:49.244915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:49.245380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:49.245529 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5244931-13d0-4f7e-a252-397014632f96) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:49.246072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:49.246731 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:49.246794 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:49.248842 np0000000669 nova-compute[97951]: INFO os_vif [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:60:b5,bridge_name='br-int',has_traffic_filtering=True,id=c5028e97-a0d6-4813-a661-dc6aec89dfbc,network=Network(a2943c12-dc01-4ff3-8292-a5a2912eea17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5028e97-a0')
May 13 04:19:49.250224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:19:49.250569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:49.250732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:49.251117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:49.251705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5ff2a40-effd-4a6f-837c-4809bb8c128c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:19:49.251705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:19:49.278785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:49.278785 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:49.278785 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:49.278785 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:49.278785 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:49.279050 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:49.279050 np0000000669 nova-compute[97951]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c (non-flash)
May 13 04:19:49.279050 np0000000669 nova-compute[97951]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:49.279050 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:49.279050 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:49.279157 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3', '86')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:19:49.279230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '76')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:49.280081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c', '77')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:19:49.280732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c719a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:19:49.280973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:19:49.281190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Flush multipath device 3300000008864b09c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:19:49.336196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:49.376886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:19:49.425433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:19:49.425663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:19:49.426966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:19:49.441441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:19:49.441864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:19:49.455427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.495651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260]
May 13 04:19:49.495651 np0000000669 nova-compute[97951]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.40.100,3260] successful.
May 13 04:19:49.495651 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.510318 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.522813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9e701ab-35ef-46b0-b254-e17c045e9dfc req-aacf8b09-eb5f-4aa7-b88b-a1e032c9a0f3 service nova] Releasing lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:49.523409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:49.523508 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:19:49.524756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.561632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260]
May 13 04:19:49.561632 np0000000669 nova-compute[97951]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-b5ff2a40-effd-4a6f-837c-4809bb8c128c, portal: 192.168.50.100,3260] successful.
May 13 04:19:49.561632 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.572161 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:49.578018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:49.579277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:49.579450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] <== disconnect_volume: return (328ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:49.579561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:19:49.579917 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deleting instance files /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614_del
May 13 04:19:49.580676 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deletion of /opt/stack/data/nova/instances/b6e65a61-0ae4-402c-9138-cef6ac3ae614_del complete
May 13 04:19:49.608621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2c2f3796-4c56-4e72-847e-6f9490cc5dea tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.274s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:49.682956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:50.082596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.442s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:50.082596 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:19:50.085669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.918s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.092681 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:19:50.093027 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Claim successful on node np0000000669
May 13 04:19:50.098990 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Took 1.73 seconds to destroy the instance on the hypervisor.
May 13 04:19:50.099906 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:19:50.100283 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:19:50.100442 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:19:50.101575 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:50.107909 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:50.211073 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:50.211300 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:50.211796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.211796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:50.211796 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:50.211938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:50.212087 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:50.212143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Acquiring lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:50.212315 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.212934 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:50.213110 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] No waiting events found dispatching network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:50.213547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0b601578-c7da-487e-bed8-3ac4f7f7fd80 req-57239020-db8b-484f-ab19-0b63c1277949 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-unplugged-c5028e97-a0d6-4813-a661-dc6aec89dfbc for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:50.312243 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:50.338933 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:50.363245 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:19:50.365066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:19:50.365066 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Creating image(s)
May 13 04:19:50.368202 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:19:50.368410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Ensure instance console log exists: /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:19:50.368707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:50.368820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.368973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:50.541199 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Updating instance_info_cache with network_info: [{"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:50.595907 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:19:50.599064 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:19:50.599492 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:50.600060 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:50.708246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:50.708246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.708421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:50.708557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:50.708659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:50.713955 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Terminating instance
May 13 04:19:50.732867 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '479dc75c23e64df8b8df396b3c077c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15743507272b4687a350f2974d99a4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:19:50.918837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ac155cbc-75e2-44ce-9ccc-f65abf4e2c28 req-bba49758-94cb-42d7-ad85-cb033a5968b5 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Received event network-vif-deleted-c5028e97-a0d6-4813-a661-dc6aec89dfbc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:50.919279 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ac155cbc-75e2-44ce-9ccc-f65abf4e2c28 req-bba49758-94cb-42d7-ad85-cb033a5968b5 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Neutron deleted interface c5028e97-a0d6-4813-a661-dc6aec89dfbc; detaching it from the instance and deleting it from the info cache
May 13 04:19:50.919437 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ac155cbc-75e2-44ce-9ccc-f65abf4e2c28 req-bba49758-94cb-42d7-ad85-cb033a5968b5 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:51.043159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-4f08cf99-2921-4750-b4fb-061177a12469" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:51.043473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance network_info: |[{"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:19:51.044030 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Start _get_guest_xml network_info=[{"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4f08cf99-2921-4750-b4fb-061177a12469', 'attached_at': '', 'detached_at': '', 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'serial': '2aa4a007-f72e-4014-913c-ea798a6792db', 'multiattach': True}, 'disk_bus': 'virtio', 'attachment_id': 'd2fe585b-116b-4006-8079-3f52833a183f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:19:51.046488 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:19:51.047775 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-735773375', uuid='4f08cf99-2921-4750-b4fb-061177a12469'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645991.0473802) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:19:51.049421 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:19:51.049737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:19:51.050749 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:19:51.051009 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:19:51.054195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:19:51.054715 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:19:51.054947 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:19:51.055112 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:19:51.055315 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:19:51.055497 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:19:51.055649 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:19:51.055890 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:19:51.056059 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:19:51.056239 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:19:51.056428 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:19:51.056614 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:19:51.068235 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:19:51.068577 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:51.068685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:51.069021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:51.069256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:51.080981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:51.081502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:51.081919 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:51.082137 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:51.082494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:51.082657 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:51.094652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:51.094652 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:51.101073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:51.101073 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db] added
May 13 04:19:51.109707 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:51.109707 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:51.109707 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:51.110221 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:51.110950 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:19:51.119639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db] added
May 13 04:19:51.119639 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:51.119639 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:51.119639 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:51.119639 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:51.119639 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:51.119639 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:51.120130 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:51.120170 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:51.120662 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:51.220756 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:19:51.239680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.243780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.256970 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Successfully created port: 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:19:51.271968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.284148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.306239 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.311344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.335304 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:51.426702 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ac155cbc-75e2-44ce-9ccc-f65abf4e2c28 req-bba49758-94cb-42d7-ad85-cb033a5968b5 service nova] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Detach interface failed, port_id=c5028e97-a0d6-4813-a661-dc6aec89dfbc, reason: Instance b6e65a61-0ae4-402c-9138-cef6ac3ae614 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:19:51.537226 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.548825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:51.557160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:51.557160 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:51.571618 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999653327999795 future=<Future at 0x7a464828b2c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:19:51.581414 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Instance destroyed successfully.
May 13 04:19:51.582033 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'resources' on Instance uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:51.620618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:19:51.837746 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Took 1.74 seconds to deallocate network for instance.
May 13 04:19:51.948739 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Successfully updated port: 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:19:52.006623 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:52.006803 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing instance network info cache due to event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:19:52.007001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:52.007178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:52.007994 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:19:52.060593 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:52.085192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1788335114',display_name='tempest-AttachVolumeNegativeTest-server-1788335114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1788335114',id=35,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM12W05AffzMk/Znp63ocP5v1muRFhfsEIVghvi301ziW8kbDfk0Nzo853qugJQrj8RuTdHFpN0vS+du3qilTpqp36C8w0E5tY91aTD28ETUZBG0PRvpoybKzQ3HnXj2yg==',key_name='tempest-keypair-937314002',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:18:55Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-ty9a2e5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=ebcb283c-a661-421d-b276-132c83950c5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:19:52.085786 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "address": "fa:16:3e:8e:97:53", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bf2e16-f3", "ovs_interfaceid": "e9bf2e16-f33c-4337-bc33-e01983584e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:52.085941 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:52.086234 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:19:52.089734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.089734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9bf2e16-f3, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:52.091003 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.091298 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:52.092008 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.092820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.093045 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddcf77d3-6cca-473e-9d14-636f6797edbe) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:52.094470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.094539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:52.095011 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:52.096973 np0000000669 nova-compute[97951]: INFO os_vif [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:97:53,bridge_name='br-int',has_traffic_filtering=True,id=e9bf2e16-f33c-4337-bc33-e01983584e7a,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bf2e16-f3')
May 13 04:19:52.097238 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Deleting instance files /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a_del
May 13 04:19:52.098014 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Deletion of /opt/stack/data/nova/instances/ebcb283c-a661-421d-b276-132c83950c5a_del complete
May 13 04:19:52.110344 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:52.121271 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:52.123929 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:52.123929 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.127115 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Booting with volume 61038aa7-c529-45dd-8532-b9c495ed9681 at /dev/vda
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:52.135857 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:52.135857 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.142601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.150823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.157364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.157364 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.157364 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:52.157364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.157364 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.157364 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:52.166353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.166353 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.166353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:52.166353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.166353 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.166353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:52.182311 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:52.196048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:19:52.196709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.40.100,3260]
May 13 04:19:52.196709 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.40.100,3260] successful.
May 13 04:19:52.196709 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.218556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.50.100,3260]
May 13 04:19:52.218556 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.50.100,3260] successful.
May 13 04:19:52.218556 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.219020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.230637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:52.243743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:52.244983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.244983 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.244983 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.244983 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.244983 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:52.245191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.245191 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.245191 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.245191 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.245191 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:52.246329 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:52.246611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:52.247729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('7', '-', '-', 0) found on session 87 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:52.247886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:52.259951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.259951 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.259951 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.259951 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.259951 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:52.260239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac266012-59a3-41c0-9a23-0df66b56c0fa (non-flash)
May 13 04:19:52.260239 np0000000669 nova-compute[97951]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:52.260239 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.260239 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:52.260239 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:52.260590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:52.260590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:52.267768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('8', '-', '-', 0) found on session 88 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:52.267768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:52.269785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 87 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:52.270052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:52.270842 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:19:52.271594 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:19:52.285862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:19:52.286434 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646'] 
May 13 04:19:52.286612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:19:52.287167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:19:52.287167 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:52.287422 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating existing volume attachment record: e002eff7-46ef-426a-94b3-ef371df0657b {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:19:52.293914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:52.294485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:52.295065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:52.295205 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:52.295347 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] No waiting events found dispatching network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:52.295476 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:52.295573 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:52.297125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 88 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:52.297588 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:52.297934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:52.298487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:52.298664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] Lock "ebcb283c-a661-421d-b276-132c83950c5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:52.299449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] No waiting events found dispatching network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:19:52.299449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a1e609b-fa26-4b93-b798-4d182091b4bd req-763b031d-3f15-4861-9135-618a59891f87 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-unplugged-e9bf2e16-f33c-4337-bc33-e01983584e7a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:19:52.427411 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Took 0.59 seconds to detach 1 volumes for instance.
May 13 04:19:52.431395 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Deleting volume: b5ff2a40-effd-4a6f-837c-4809bb8c128c {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:19:52.453467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:52.510408 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:52.569391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.484s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:52.569990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:19:52.600434 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:52.611315 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:19:52.615006 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:19:52.615339 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:19:52.615564 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:19:52.615782 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:52.750041 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:52.784689 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:52.995207 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:52.995442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:53.078525 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:19:53.078710 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:19:53.078988 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:53.079182 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:53.085292 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:19:53.179416 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:19:53.289864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc36f9b1-0b0e-49b1-b376-cc61e800b5eb req-3d89cc48-8250-4bef-ac4f-29cce215ac65 service nova] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:53.290495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:53.290785 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:19:53.359528 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:53.359778 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:53.581924 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:19:53.689793 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:53.701184 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Successfully created port: 2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:19:53.861428 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:53.863306 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:54.080176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cd1e6933-9f12-4471-9c18-85ed6ab95792 req-2aecef18-d906-41a5-8406-356a12a82d95 service nova] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Received event network-vif-deleted-e9bf2e16-f33c-4337-bc33-e01983584e7a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:54.086486 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:19:54.109123 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 3300000009902ebb1 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:19:54.109540 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:54.110336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000009902ebb1', 'path': '/dev/dm-0', 'multipath_id': '3300000009902ebb1'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:54.110336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009902ebb1', 'path': '/dev/dm-0', 'multipath_id': '3300000009902ebb1'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:19:54.120592 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:54.192497 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Took 1.58 seconds to deallocate network for instance.
May 13 04:19:54.278148 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Successfully updated port: 2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:19:54.294289 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:54.342455 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-changed-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:54.342741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Refreshing instance network info cache due to event network-changed-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:19:54.342929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] Acquiring lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:54.343062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] Acquired lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:54.343221 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Refreshing network info cache for port 2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:19:54.374169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.379s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:54.438715 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Deleted allocations for instance b6e65a61-0ae4-402c-9138-cef6ac3ae614
May 13 04:19:54.456696 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:19:54.458559 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:19:54.458559 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Creating image(s)
May 13 04:19:54.458875 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:19:54.459037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Ensure instance console log exists: /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:19:54.459670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:54.459866 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:54.460045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:54.593293 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Booting with volume ea7340e8-8978-474d-a38c-1ee50640489f at /dev/vda
May 13 04:19:54.618398 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-735773375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-735773375',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-gfd4kwov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:48Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=4f08cf99-2921-4750-b4fb-061177a12469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:19:54.618398 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:54.619192 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:54.619902 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f08cf99-2921-4750-b4fb-061177a12469 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:54.639021 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:54.654342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:19:54.682428 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:54.721558 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:54.729378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:54.729779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:54.747662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:19:54.747946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:19:54.756754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:19:54.757787 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646'] 
May 13 04:19:54.757937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:19:54.758066 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:19:54.758358 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:54.758573 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Updating existing volume attachment record: 2797f6ed-4195-4638-8db6-164eaa9e394f {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:19:54.779869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:19:54.800291 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:54.800291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance network_info: |[{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:19:54.800291 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Start _get_guest_xml network_info=[{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fd379e34-a21d-45c7-99e6-6f77272bc1ce', 'attached_at': '', 'detached_at': '', 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'serial': '61038aa7-c529-45dd-8532-b9c495ed9681'}, 'disk_bus': 'virtio', 'attachment_id': 'e002eff7-46ef-426a-94b3-ef371df0657b', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:19:54.804089 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:19:54.805500 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-139715745', uuid='fd379e34-a21d-45c7-99e6-6f77272bc1ce'), owner=OwnerMeta(userid='479dc75c23e64df8b8df396b3c077c26', username='tempest-TestInstancesWithCinderVolumes-471064079-project-member', projectid='15743507272b4687a350f2974d99a4ae', projectname='tempest-TestInstancesWithCinderVolumes-471064079'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645994.8048835) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:19:54.806870 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:19:54.807268 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:19:54.808218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:19:54.808443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:19:54.809515 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:19:54.809835 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:19:54.810035 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:19:54.810154 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:19:54.810250 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:19:54.810344 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:19:54.810447 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:19:54.810585 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:19:54.810720 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:19:54.810782 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:19:54.810901 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:19:54.811032 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:19:54.821188 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:19:54.821496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:54.821830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:54.822516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:54.822516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:54.836493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:54.837365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:54.838002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:54.838206 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:54.838625 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:54.838845 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:54.846157 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:54.849372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:54.849372 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:54.856125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:54.856125 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681] added
May 13 04:19:54.864777 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:54.864777 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:54.864777 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:54.872033 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681] added
May 13 04:19:54.872033 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:54.872033 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:54.872033 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:54.872033 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:54.872033 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:54.872033 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:54.872353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:54.872353 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:54.872465 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:54.935062 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:55.026724 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:19:55.026958 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:19:55.110293 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] End _get_guest_xml xml=<domain type="qemu">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <uuid>4f08cf99-2921-4750-b4fb-061177a12469</uuid>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <name>instance-00000024</name>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-735773375</nova:name>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:19:51</nova:creationTime>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         <nova:port uuid="63301e2e-3bf0-4642-a9ba-fc3fd73e5086">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <system>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="serial">4f08cf99-2921-4750-b4fb-061177a12469</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="uuid">4f08cf99-2921-4750-b4fb-061177a12469</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </system>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <os>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </os>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <features>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </features>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   <devices>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/disk.config"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <alias name="ua-2aa4a007-f72e-4014-913c-ea798a6792db"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <serial>2aa4a007-f72e-4014-913c-ea798a6792db</serial>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <shareable/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d7:72:ba"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <target dev="tap63301e2e-3b"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </interface>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/console.log" append="off"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </serial>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <video>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </video>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </rng>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:   </devices>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: </domain>
May 13 04:19:55.124653 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Preparing to wait for external event network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:55.124653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-735773375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-735773375',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-gfd4kwov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:48Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=4f08cf99-2921-4750-b4fb-061177a12469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.128144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f78eca77-7189-5324-ab36-42e0b9bc56e0', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:55.129399 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.130258 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:55.130782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.132800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.133070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63301e2e-3b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:55.133375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63301e2e-3b, col_values=(('qos', UUID('28d74c0c-eafb-40f1-99a3-d499d3388ebf')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:55.133651 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63301e2e-3b, col_values=(('external_ids', {'iface-id': '63301e2e-3bf0-4642-a9ba-fc3fd73e5086', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:72:ba', 'vm-uuid': '4f08cf99-2921-4750-b4fb-061177a12469'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:55.134843 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.136185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:55.152294 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:55.153581 np0000000669 nova-compute[97951]: INFO os_vif [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b')
May 13 04:19:55.454141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b2682032-2f28-42d1-aab2-2e3b73790820 tempest-ServerActionsV293TestJSON-1586826136 tempest-ServerActionsV293TestJSON-1586826136-project-member] Lock "b6e65a61-0ae4-402c-9138-cef6ac3ae614" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.589s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:55.529771 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:19:55.612264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-135e7ab0-5a0e-4228-b065-6d80f857dc34 req-52df4010-6d9e-4621-8979-2277566c3c6d service nova] Releasing lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:55.612791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:19:55.613087 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:19:55.865578 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:55.872961 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:55.879972 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:55.879972 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:55.888578 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:55.888578 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.894413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.902675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.915356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.915356 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.915356 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.915356 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:55.915505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.915505 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.915505 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.915505 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.917469 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:55.949179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.40.100,3260]
May 13 04:19:55.949179 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.40.100,3260] successful.
May 13 04:19:55.949179 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.961841 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.962533 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.50.100,3260]
May 13 04:19:55.962533 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.50.100,3260] successful.
May 13 04:19:55.962533 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.978746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:55.980021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.980021 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.980021 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.980021 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.980021 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.980021 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:55.980855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.980855 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.980855 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.980855 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.980855 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.980855 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:55.981266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:55.981405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:55.982521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('9', '-', '-', 0) found on session 89 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:55.982521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:55.995805 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.995805 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.995805 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.995805 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.995805 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.995805 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:55.995945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:55.995945 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.995945 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:55.995945 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.995945 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:55.995945 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:55.996091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:55.996193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:55.997112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('10', '-', '-', 0) found on session 90 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:55.997182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:55.999398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 89 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:55.999583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:56.015233 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 90 and hctl ['10', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:56.036816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.307s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:56.136167 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Deleted allocations for instance ebcb283c-a661-421d-b276-132c83950c5a
May 13 04:19:56.237718 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:19:56.436646 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:56.582215 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Updating instance_info_cache with network_info: [{"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:19:56.584072 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:19:56.670890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:56.671082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:19:56.671226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:d7:72:ba, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:19:56.671634 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Using config drive
May 13 04:19:56.861185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:19:56.862531 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:19:56.862659 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Creating image(s)
May 13 04:19:56.862921 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:19:56.864178 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Ensure instance console log exists: /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:19:56.864460 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:56.864653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:56.864811 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:57.016596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 90 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:57.016766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:57.086744 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-63d8cb8c-e848-4309-8760-6e9646233b9e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:19:57.087008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance network_info: |[{"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:19:57.087707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Start _get_guest_xml network_info=[{"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '63d8cb8c-e848-4309-8760-6e9646233b9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'serial': 'ea7340e8-8978-474d-a38c-1ee50640489f'}, 'disk_bus': 'virtio', 'attachment_id': '2797f6ed-4195-4638-8db6-164eaa9e394f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:19:57.090983 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] While synchronizing instance power states, found 4 instances in the database and 1 instances on the hypervisor.
May 13 04:19:57.091174 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid 4f08cf99-2921-4750-b4fb-061177a12469 {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:19:57.091682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:19:57.092765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:57.093632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid 63d8cb8c-e848-4309-8760-6e9646233b9e {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:19:57.094355 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:57.095731 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:19:57.096427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid ebcb283c-a661-421d-b276-132c83950c5a {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:19:57.097924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:57.099700 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1538922557', uuid='63d8cb8c-e848-4309-8760-6e9646233b9e'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778645997.0971396) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:19:57.100445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "ebcb283c-a661-421d-b276-132c83950c5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:57.100445 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 25.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:19:57.104162 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:19:57.104707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:19:57.107128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:19:57.107312 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:19:57.108543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:19:57.108881 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:19:57.109211 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:19:57.109279 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:19:57.109490 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:19:57.109638 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:19:57.109858 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:19:57.110107 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:19:57.110253 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:19:57.110440 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:19:57.110616 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:19:57.110773 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:19:57.126211 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:19:57.127297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:19:57.127297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:57.144816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3fe72333-cc36-4d5f-8e96-fb557fdefe71 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.436s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:57.145884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "ebcb283c-a661-421d-b276-132c83950c5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:57.176966 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:19:57.296120 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Creating config drive at /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/disk.config
May 13 04:19:57.299626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm9n1yo_t {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:19:57.348513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm9n1yo_t" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:19:57.652520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "ebcb283c-a661-421d-b276-132c83950c5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:57.779583 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:57.807220 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:57.857620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found WWN 3300000001243ad3b for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:19:57.857620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:57.857620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000001243ad3b', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ad3b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:19:57.857620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001243ad3b', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ad3b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:19:57.860169 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.732s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:57.860169 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:19:57.874529 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:57.875264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:19:57.875813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:57.876120 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:57.876479 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:19:57.877448 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:57.893610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:57.893610 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:57.901787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:19:57.901787 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:57.908501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f] added
May 13 04:19:57.910996 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:57.910996 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:57.910996 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:57.913109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f] added
May 13 04:19:57.920739 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:19:57.920739 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:19:57.920739 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:19:57.984821 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-23447ca2-b241-43cd-a525-4d5efa65f6da req-03cc2618-5b93-4bd8-9eeb-4d801708cf6b service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:19:57.985478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-23447ca2-b241-43cd-a525-4d5efa65f6da req-03cc2618-5b93-4bd8-9eeb-4d801708cf6b service nova] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:57.985724 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-23447ca2-b241-43cd-a525-4d5efa65f6da req-03cc2618-5b93-4bd8-9eeb-4d801708cf6b service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:57.985895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-23447ca2-b241-43cd-a525-4d5efa65f6da req-03cc2618-5b93-4bd8-9eeb-4d801708cf6b service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:57.986612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-23447ca2-b241-43cd-a525-4d5efa65f6da req-03cc2618-5b93-4bd8-9eeb-4d801708cf6b service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Processing event network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:19:58.123370 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.210607 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.214765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.217178 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.243504 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.371089 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-139715745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testinstanceswithcindervolumes-server-139715745',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc0e0MnGGp3UlrPQ3YLc8kNyzmLWl8BaZh2oIgU/oofD2hchAKM9YWnkdB0Ip2l8FBUkfG/nFaRhY6juYhRunv66LnTTnk77dX5L54LT2prJ50H78XDVpAOAEisQ5f/8g==',key_name='tempest-TestInstancesWithCinderVolumes-1412390341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15743507272b4687a350f2974d99a4ae',ramdisk_id='',reservation_id='r-9owiwkqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-471064079',owner_user_name='tempest-TestInstancesWithCinderVolumes-471064079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:52Z,user_data=None,user_id='479dc75c23e64df8b8df396b3c077c26',uuid=fd379e34-a21d-45c7-99e6-6f77272bc1ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:19:58.371263 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converting VIF {"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:58.372136 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:58.373149 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'pci_devices' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:19:58.758273 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645998.7572155, 4f08cf99-2921-4750-b4fb-061177a12469 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:58.758837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:19:58.759062 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] VM Started (Lifecycle Event)
May 13 04:19:58.761819 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:19:58.764630 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance spawned successfully.
May 13 04:19:58.765119 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:19:58.876925 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] End _get_guest_xml xml=<domain type="qemu">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <uuid>fd379e34-a21d-45c7-99e6-6f77272bc1ce</uuid>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <name>instance-00000025</name>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-139715745</nova:name>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:19:54</nova:creationTime>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:user uuid="479dc75c23e64df8b8df396b3c077c26">tempest-TestInstancesWithCinderVolumes-471064079-project-member</nova:user>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:project uuid="15743507272b4687a350f2974d99a4ae">tempest-TestInstancesWithCinderVolumes-471064079</nova:project>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         <nova:port uuid="36fc68cd-737b-450b-972a-7e314187c3cd">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <system>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="serial">fd379e34-a21d-45c7-99e6-6f77272bc1ce</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="uuid">fd379e34-a21d-45c7-99e6-6f77272bc1ce</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </system>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <os>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </os>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <features>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </features>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   <devices>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/disk.config"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <alias name="ua-61038aa7-c529-45dd-8532-b9c495ed9681"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <serial>61038aa7-c529-45dd-8532-b9c495ed9681</serial>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </disk>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d8:74:d9"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <target dev="tap36fc68cd-73"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </interface>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/console.log" append="off"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </serial>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <video>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </video>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </rng>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:   </devices>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]: </domain>
May 13 04:19:58.876925 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Preparing to wait for external event network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-139715745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testinstanceswithcindervolumes-server-139715745',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc0e0MnGGp3UlrPQ3YLc8kNyzmLWl8BaZh2oIgU/oofD2hchAKM9YWnkdB0Ip2l8FBUkfG/nFaRhY6juYhRunv66LnTTnk77dX5L54LT2prJ50H78XDVpAOAEisQ5f/8g==',key_name='tempest-TestInstancesWithCinderVolumes-1412390341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15743507272b4687a350f2974d99a4ae',ramdisk_id='',reservation_id='r-9owiwkqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-471064079',owner_user_name='tempest-TestInstancesWithCinderVolumes-471064079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:52Z,user_data=None,user_id='479dc75c23e64df8b8df396b3c077c26',uuid=fd379e34-a21d-45c7-99e6-6f77272bc1ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converting VIF {"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:19:58.880144 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:19:58.880492 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:19:58.881069 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.881395 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:58.881735 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:19:58.882305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.882491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43761543-df96-5fdc-973e-02d134bfa25c', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:58.883370 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.884600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:58.885052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.886744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.886924 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36fc68cd-73, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:58.887386 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36fc68cd-73, col_values=(('qos', UUID('8fdc3140-5d87-4ba6-824f-f02b23e06e2b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:58.887582 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36fc68cd-73, col_values=(('external_ids', {'iface-id': '36fc68cd-737b-450b-972a-7e314187c3cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:74:d9', 'vm-uuid': 'fd379e34-a21d-45c7-99e6-6f77272bc1ce'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:19:58.888741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.890147 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:19:58.897410 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:58.898756 np0000000669 nova-compute[97951]: INFO os_vif [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73')
May 13 04:19:58.911130 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:19:58.922038 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:58.930939 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:58.930939 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:19:58.940262 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:19:58.940262 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:58.946205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:58.958446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:58.966880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:58.966880 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.966880 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.966880 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.966880 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.966880 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:58.967124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:58.967124 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.967124 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.967124 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.967124 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.967124 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:58.977743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:58.977743 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.977743 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.977743 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.977743 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.977743 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:58.977970 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:58.977970 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.977970 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:58.977970 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.977970 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:58.977970 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:59.015400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.50.100,3260]
May 13 04:19:59.015400 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.50.100,3260] successful.
May 13 04:19:59.015400 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:59.034064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:59.035369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.40.100,3260]
May 13 04:19:59.035369 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.40.100,3260] successful.
May 13 04:19:59.035369 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:59.054025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.066564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:59.069506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:59.069506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:59.070859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('11', '-', '-', 0) found on session 91 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:59.071461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.074340 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fd2b38d-498e-42a6-b152-a034110961e3 (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:19:59.074519 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:19:59.074968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:19:59.075121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:19:59.076795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('12', '-', '-', 0) found on session 92 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:19:59.076978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:19:59.095546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 91 and hctl ['11', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:59.104370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 92 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:19:59.104370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:19:59.262411 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:19:59.269158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.278349 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:19:59.688683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:19:59.773598 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:19:59.774202 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778645999.7736883, 4f08cf99-2921-4750-b4fb-061177a12469 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:19:59.774202 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] VM Paused (Lifecycle Event)
May 13 04:19:59.787623 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Took 9.42 seconds to spawn the instance on the hypervisor.
May 13 04:19:59.788027 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:00.070114 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:00.070306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:00.071457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:00.071457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:00.071457 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] No waiting events found dispatching network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:00.071457 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-60bb447b-db96-4036-9a9e-7ce716a45337 req-cf8f86cb-6a56-4362-93e1-93bb3e82a665 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received unexpected event network-vif-plugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 for instance with vm_state active and task_state None.
May 13 04:20:00.095866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 91 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:00.096068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:00.278524 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:00.286586 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646000.2859128, 4f08cf99-2921-4750-b4fb-061177a12469 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:00.286586 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] VM Resumed (Lifecycle Event)
May 13 04:20:00.304648 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Took 16.99 seconds to build instance.
May 13 04:20:00.431078 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:00.431178 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:00.431293 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No VIF found with MAC fa:16:3e:d8:74:d9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:00.431637 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Using config drive
May 13 04:20:00.791626 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:00.795949 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:00.806868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.502s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:00.807379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "4f08cf99-2921-4750-b4fb-061177a12469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.715s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:00.807526 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:00.807646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "4f08cf99-2921-4750-b4fb-061177a12469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:00.876269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:00.876540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:00.904477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 33000000020699b22 for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:20:00.905194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:00.907524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3779ms) {'type': 'block', 'scsi_wwn': '33000000020699b22', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000020699b22'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:00.907524 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000020699b22', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000020699b22'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:20:00.939517 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:00.948676 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '63d8cb8c-e848-4309-8760-6e9646233b9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'serial': 'ea7340e8-8978-474d-a38c-1ee50640489f'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:20:00.949386 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:20:00.949683 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:00.954612 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:00.977179 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.luks [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 04:20:00.977570 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:20:00.977769 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:00.978068 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:00.978584 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7a46483b45c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '63d8cb8c-e848-4309-8760-6e9646233b9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'serial': 'ea7340e8-8978-474d-a38c-1ee50640489f'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:20:00.978742 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] formatting encrypted volume /dev/dm-6 {{(pid=97951) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 04:20:01.115083 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Creating config drive at /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/disk.config
May 13 04:20:01.119864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv5v1cmf {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:01.203351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv5v1cmf" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:01.384509 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:01.722526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:01.753256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:01.756676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:01.864004 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:01.975294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:01.975936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:01.984104 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:01.984338 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Claim successful on node np0000000669
May 13 04:20:02.144642 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:02.150773 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:02.154024 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:02.155115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:02.180931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:02.185053 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-44e070f5-09c0-46a1-a9f8-8aa0138a4646 req-dbb284f6-95b4-4719-8058-1ac4f05699b5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:02.185506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-44e070f5-09c0-46a1-a9f8-8aa0138a4646 req-dbb284f6-95b4-4719-8058-1ac4f05699b5 service nova] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:02.186006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-44e070f5-09c0-46a1-a9f8-8aa0138a4646 req-dbb284f6-95b4-4719-8058-1ac4f05699b5 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:02.186573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-44e070f5-09c0-46a1-a9f8-8aa0138a4646 req-dbb284f6-95b4-4719-8058-1ac4f05699b5 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:02.186827 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-44e070f5-09c0-46a1-a9f8-8aa0138a4646 req-dbb284f6-95b4-4719-8058-1ac4f05699b5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Processing event network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:02.759297 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:02.759725 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646002.7593894, fd379e34-a21d-45c7-99e6-6f77272bc1ce => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:02.759803 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] VM Started (Lifecycle Event)
May 13 04:20:02.763496 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:02.766432 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance spawned successfully.
May 13 04:20:02.768224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:03.263798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:03.275005 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:03.282558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.282558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.282558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.283422 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.283875 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.284173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:03.356941 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:03.357183 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:03.365251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:03.504008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:03.504293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:03.724013 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005035159999806638 future=<Future at 0x7a463c107ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:03.724314 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:03.724314 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.846482488999982 future=<Future at 0x7a464828b2c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:03.724438 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.846354326999972 future=<Future at 0x7a464828b2c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:03.725956 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Emitting event <LifecycleEvent: 1778645988.7233741, b6e65a61-0ae4-402c-9138-cef6ac3ae614 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:03.726138 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] VM Stopped (Lifecycle Event)
May 13 04:20:03.781539 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:03.782067 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646003.7815242, fd379e34-a21d-45c7-99e6-6f77272bc1ce => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:03.782306 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] VM Paused (Lifecycle Event)
May 13 04:20:03.795456 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Took 9.34 seconds to spawn the instance on the hypervisor.
May 13 04:20:03.795456 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:03.862722 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:03.888610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:04.006690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:04.229010 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: b6e65a61-0ae4-402c-9138-cef6ac3ae614] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:04.285974 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:04.290672 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646004.290397, fd379e34-a21d-45c7-99e6-6f77272bc1ce => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:04.290917 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] VM Resumed (Lifecycle Event)
May 13 04:20:04.308732 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Took 16.74 seconds to build instance.
May 13 04:20:04.375565 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.399s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:04.375565 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] No waiting events found dispatching network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:04.423801 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-db9f5198-3bd7-439c-af70-3d3cbf03c96e req-ba13e149-d0fc-4590-860f-477a46d93c97 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received unexpected event network-vif-plugged-36fc68cd-737b-450b-972a-7e314187c3cd for instance with vm_state active and task_state None.
May 13 04:20:04.587663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:04.587855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:04.596349 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:04.596349 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Claim successful on node np0000000669
May 13 04:20:04.691362 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:04.794800 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:04.802435 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:04.813736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-05e316e1-4f82-41a6-ae8d-e500ca2418f4 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.259s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:04.817663 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.723s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:04.817813 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:04.817926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:04.882993 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:04.884385 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:04.886433 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:04.886515 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:04.986308 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b11065076cd40ffaa5099174eda4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c06d9163829483dafb7a6dcd1a3f194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:05.389707 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:05.536548 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:20:05.536548 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:20:05.536548 np0000000669 nova-compute[97951]:     <volume>ea7340e8-8978-474d-a38c-1ee50640489f</volume>
May 13 04:20:05.536548 np0000000669 nova-compute[97951]:   </usage>
May 13 04:20:05.536548 np0000000669 nova-compute[97951]: </secret>
May 13 04:20:05.536548 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:20:05.894475 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:05.992346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:05.992346 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:06.052968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1538922557',display_name='tempest-TestVolumeBootPattern-server-1538922557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1538922557',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-pwdht8hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:54Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=63d8cb8c-e848-4309-8760-6e9646233b9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:06.053208 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:06.053804 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:06.054901 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 63d8cb8c-e848-4309-8760-6e9646233b9e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:06.269587 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.496932 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:06.505169 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:06.510159 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing instance network info cache due to event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:06.510159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:06.510159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:06.510159 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:06.562055 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <uuid>63d8cb8c-e848-4309-8760-6e9646233b9e</uuid>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <name>instance-00000026</name>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-1538922557</nova:name>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:19:57</nova:creationTime>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <nova:port uuid="2854bb9b-b5ae-44d4-acbb-b6fb68cb7119">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="serial">63d8cb8c-e848-4309-8760-6e9646233b9e</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="uuid">63d8cb8c-e848-4309-8760-6e9646233b9e</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/disk.config"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <alias name="ua-ea7340e8-8978-474d-a38c-1ee50640489f"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <serial>ea7340e8-8978-474d-a38c-1ee50640489f</serial>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <encryption format="luks">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:         <secret type="passphrase" uuid="52deae65-76e7-4220-bfb7-152ade8368f2"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       </encryption>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:9f:8c:84"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <target dev="tap2854bb9b-b5"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/console.log" append="off"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:06.562055 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Preparing to wait for external event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1538922557',display_name='tempest-TestVolumeBootPattern-server-1538922557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1538922557',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-pwdht8hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:19:54Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=63d8cb8c-e848-4309-8760-6e9646233b9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:06.565275 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:06.566208 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:06.567346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.567346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:06.567538 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:06.568921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.569143 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55d1b416-b5cc-515e-b897-7b143b26440e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:06.571561 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0007816620000085095 future=<Future at 0x7a464828b2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:06.573109 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:06.573109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.573109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:06.574553 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] Emitting event <LifecycleEvent: 1778645991.5706735, ebcb283c-a661-421d-b276-132c83950c5a => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:06.574968 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] VM Stopped (Lifecycle Event)
May 13 04:20:06.579547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.583192 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2854bb9b-b5, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:06.583192 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2854bb9b-b5, col_values=(('qos', UUID('47202c6a-f280-4fd7-9070-428926b1ead6')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:06.583192 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2854bb9b-b5, col_values=(('external_ids', {'iface-id': '2854bb9b-b5ae-44d4-acbb-b6fb68cb7119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:8c:84', 'vm-uuid': '63d8cb8c-e848-4309-8760-6e9646233b9e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:06.583192 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.585176 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:06.592357 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:06.594110 np0000000669 nova-compute[97951]: INFO os_vif [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5')
May 13 04:20:06.744571 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Successfully created port: 48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:06.906874 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:06.908537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:06.908903 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Creating image(s)
May 13 04:20:06.910583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:06.910583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:06.910583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:06.911594 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:06.915942 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:06.918994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:07.019283 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:07.029688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.430s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:07.030831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:07.037536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.120s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:07.039252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:07.039557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:07.040432 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:07.047886 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:07.049240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:07.086210 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c6db9c98-e843-430a-8cf8-f735db8e84c0 tempest-VolumesActionsTest-1546546431 tempest-VolumesActionsTest-1546546431-project-member] [instance: ebcb283c-a661-421d-b276-132c83950c5a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:07.172069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:07.172666 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:07.261974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk 1073741824" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:07.263222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:07.265813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:07.368453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:07.368453 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:07.368453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:07.492743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:07.493540 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Cannot resize image /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:07.494185 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:07.494418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Ensure instance console log exists: /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:07.494740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:07.495159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:07.495369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:07.518159 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Successfully updated port: 48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:07.543351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:07.543672 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:07.544002 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:07.544966 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:07.589814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-changed-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:07.589881 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Refreshing instance network info cache due to event network-changed-48a2ef47-e423-4089-94cb-2fbecdbcab81. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:07.590092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] Acquiring lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:07.590230 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] Acquired lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:07.590592 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Refreshing network info cache for port 48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:07.832912 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:07.899992 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:08.027150 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:08.048058 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:08.096222 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:08.126880 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updated VIF entry in instance network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:08.127242 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:08.130730 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:08.130955 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:08.131004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:9f:8c:84, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:08.131455 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Using config drive
May 13 04:20:08.186402 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:08.431524 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:08.520490 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Successfully created port: 24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:08.558650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:08.632146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f8adbe17-30cb-4abc-a7e6-12bc5f4cada4 req-6c1934d5-02a1-4c72-9a5c-958688da8339 service nova] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:08.638776 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:08.793998 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Creating config drive at /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/disk.config
May 13 04:20:08.797664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvi0cdyuk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:08.858952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvi0cdyuk" returned: 0 in 0.061s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:08.935427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb19a78a-3b8d-4a10-aa21-02ddf9ec80b3 req-c19fdaf3-3adf-434f-bd40-f7b04ac64b4e service nova] Releasing lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:08.936141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquired lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:08.936448 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:09.021829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:09.022084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:09.155976 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Successfully updated port: 24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:09.276551 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:09.276970 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing instance network info cache due to event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:09.277213 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] Acquiring lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:09.277498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] Acquired lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:09.277589 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing network info cache for port 24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:09.404084 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.437141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.448865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.528221 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:09.534780 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:09.540543 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.570152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:09.572803 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:09.573564 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Creating image(s)
May 13 04:20:09.573840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:09.574024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:09.574509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:09.576003 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:09.580960 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:09.582871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:09.659268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:09.679879 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:09.680186 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing instance network info cache due to event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:09.682423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:09.683553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:09.683769 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:09.685753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:09.686583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:09.687252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:09.690604 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:09.699588 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:09.706851 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.712534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:09.782579 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:09.810012 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:09.810359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:09.843406 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:09.859450 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.877418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk 1073741824" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:09.878003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:09.878491 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:09.900350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:09.915521 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:09.992412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.113s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:09.992412 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:09.992412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:10.106122 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating instance_info_cache with network_info: [{"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:10.111881 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:10.114660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:10.116580 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:10.116894 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:10.117063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Ensure instance console log exists: /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:10.119270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:10.119659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:10.120156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:10.120342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:10.120518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:10.127035 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:10.127214 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Claim successful on node np0000000669
May 13 04:20:10.187725 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:10.615643 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Releasing lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:10.616056 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance network_info: |[{"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:10.616696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-89a67331-0543-44b3-a34e-01e5083c4caf req-c9ddfdb1-78b6-4a42-bf13-40275be1be83 service nova] Releasing lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:10.619004 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:10.619255 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:10.621789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Start _get_guest_xml network_info=[{"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:10.629797 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:10.631346 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1927455728', uuid='4b2f0d86-83ca-4a76-8950-cd2768dedf23'), owner=OwnerMeta(userid='6b11065076cd40ffaa5099174eda4db9', username='tempest-AttachVolumeNegativeTest-1451451802-project-member', projectid='4c06d9163829483dafb7a6dcd1a3f194', projectname='tempest-AttachVolumeNegativeTest-1451451802'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646010.6306596) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:10.637309 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:10.641377 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:10.642899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:10.650374 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:10.650501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:10.652409 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:10.652409 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:10.652581 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:10.652726 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:10.653390 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:10.653390 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:10.653390 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:10.654411 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:10.657346 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:10.657346 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:10.657346 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:10.657346 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:10.675740 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1927455728',display_name='tempest-AttachVolumeNegativeTest-server-1927455728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1927455728',id=39,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI1IcY1rNTnPNxSVNpHWp/2L1YwrtNWf/ekbIs9uAWvvqqsNVtA4+6MbZ8KqJ0tGWhKO9k0OkkkuhBFtaDGhSJwa4Es4UK5T1xlap0yPY6gmzHPk1+3RFpPtKsDscx06g==',key_name='tempest-keypair-594056268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-4ok1q74t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=4b2f0d86-83ca-4a76-8950-cd2768dedf23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:10.675961 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:10.676749 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:10.677575 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:10.839228 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updated VIF entry in instance network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:10.839306 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:11.184312 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <uuid>4b2f0d86-83ca-4a76-8950-cd2768dedf23</uuid>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <name>instance-00000027</name>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1927455728</nova:name>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:10</nova:creationTime>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:user uuid="6b11065076cd40ffaa5099174eda4db9">tempest-AttachVolumeNegativeTest-1451451802-project-member</nova:user>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:project uuid="4c06d9163829483dafb7a6dcd1a3f194">tempest-AttachVolumeNegativeTest-1451451802</nova:project>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         <nova:port uuid="48a2ef47-e423-4089-94cb-2fbecdbcab81">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="serial">4b2f0d86-83ca-4a76-8950-cd2768dedf23</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="uuid">4b2f0d86-83ca-4a76-8950-cd2768dedf23</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.config"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:3e:79:76"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <target dev="tap48a2ef47-e4"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/console.log" append="off"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:11.184312 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Preparing to wait for external event network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1927455728',display_name='tempest-AttachVolumeNegativeTest-server-1927455728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1927455728',id=39,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI1IcY1rNTnPNxSVNpHWp/2L1YwrtNWf/ekbIs9uAWvvqqsNVtA4+6MbZ8KqJ0tGWhKO9k0OkkkuhBFtaDGhSJwa4Es4UK5T1xlap0yPY6gmzHPk1+3RFpPtKsDscx06g==',key_name='tempest-keypair-594056268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-4ok1q74t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=4b2f0d86-83ca-4a76-8950-cd2768dedf23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:11.187577 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:11.188449 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.188449 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:11.189465 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:11.191568 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.191863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f07e6d0-a242-593e-b68e-751c246b67b6', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:11.193632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.195752 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:11.201719 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.202396 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48a2ef47-e4, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:11.202540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48a2ef47-e4, col_values=(('qos', UUID('d030d8c2-5b9b-4a12-8a44-096b128904b3')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:11.202687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48a2ef47-e4, col_values=(('external_ids', {'iface-id': '48a2ef47-e423-4089-94cb-2fbecdbcab81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:79:76', 'vm-uuid': '4b2f0d86-83ca-4a76-8950-cd2768dedf23'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:11.204648 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.206620 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:11.211761 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:11.217712 np0000000669 nova-compute[97951]: INFO os_vif [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4')
May 13 04:20:11.226840 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:11.288202 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646011.2877567, 63d8cb8c-e848-4309-8760-6e9646233b9e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:11.288435 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] VM Started (Lifecycle Event)
May 13 04:20:11.348477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ed2f143b-73eb-4f27-b23d-e02bbefa891a req-ae5ce70f-dc8f-4079-a0df-4af1b3c595c5 service nova] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:11.493661 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:11.632765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:11.633003 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:11.698612 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:11.791870 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:11.796867 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646011.7966282, 63d8cb8c-e848-4309-8760-6e9646233b9e => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:11.797056 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] VM Paused (Lifecycle Event)
May 13 04:20:12.137784 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:12.202763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:12.202763 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance network_info: |[{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:12.207457 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Start _get_guest_xml network_info=[{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:12.216153 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:12.216153 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='e6cd15e9-77cc-41e7-81f9-839b352be4a5'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646012.2154486) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:12.219120 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:12.219120 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:12.220121 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:12.220458 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:12.221533 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:12.222160 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:12.223342 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:12.223342 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:12.223342 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:12.223342 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:12.223342 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:12.223590 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:12.224061 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:12.224353 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:12.224601 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:12.224873 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:12.245670 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=40,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-hw12xryi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=e6cd15e9-77cc-41e7-81f9-839b352be4a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:12.245670 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:12.245670 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:12.245670 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:12.302475 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:12.310574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:12.646242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.524s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:12.646242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:12.743718 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:12.743869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:12.744042 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:3e:79:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:12.744639 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Using config drive
May 13 04:20:12.748764 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <uuid>e6cd15e9-77cc-41e7-81f9-839b352be4a5</uuid>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <name>instance-00000028</name>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-0</nova:name>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:12</nova:creationTime>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         <nova:port uuid="24eb43dc-ba2c-41e4-8456-3af494301b3d">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="serial">e6cd15e9-77cc-41e7-81f9-839b352be4a5</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="uuid">e6cd15e9-77cc-41e7-81f9-839b352be4a5</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.config"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:77:ed:f4"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <target dev="tap24eb43dc-ba"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/console.log" append="off"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:12.748764 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Preparing to wait for external event network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=40,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-hw12xryi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=e6cd15e9-77cc-41e7-81f9-839b352be4a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:12.750529 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:12.750859 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:12.751097 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:12.751514 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.751813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:12.752031 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:12.752743 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.752930 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9213421f-3589-5e30-9574-5392111763a7', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:12.761030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.761848 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:12.770703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.772938 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.773163 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24eb43dc-ba, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:12.773572 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24eb43dc-ba, col_values=(('qos', UUID('42dc0b29-4676-4582-9ca2-338707056a37')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:12.773746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24eb43dc-ba, col_values=(('external_ids', {'iface-id': '24eb43dc-ba2c-41e4-8456-3af494301b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:ed:f4', 'vm-uuid': 'e6cd15e9-77cc-41e7-81f9-839b352be4a5'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:12.774820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.778032 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:12.787075 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:12.788441 np0000000669 nova-compute[97951]: INFO os_vif [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba')
May 13 04:20:12.813022 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:13.152844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:13.152844 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:13.153018 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:13.153205 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:13.222693 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc9870910ccc42fe85fafc4b7facf3d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a84b573397740d5b3723cedeea8afe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:13.254364 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:13.381920 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Creating config drive at /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.config
May 13 04:20:13.386067 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9m90idxt {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:13.441721 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:13.442163 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:13.442594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:13.442724 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:13.443910 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] No event matching network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 in dict_keys([('network-vif-plugged', '48a2ef47-e423-4089-94cb-2fbecdbcab81')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:20:13.443910 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-da2361ef-607e-4a65-8369-305d0dc86045 req-3c86c441-963e-400b-94bf-ac146e3847cd service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received unexpected event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 for instance with vm_state building and task_state spawning.
May 13 04:20:13.454659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9m90idxt" returned: 0 in 0.068s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:13.653168 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:13.944447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:13.972519 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Successfully created port: 0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:13.986622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.111623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.159052 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:14.327171 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:14.329778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:14.329778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:77:ed:f4, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:14.329778 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Using config drive
May 13 04:20:14.369208 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.373657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.376727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.410845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.419179 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.649736 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Successfully updated port: 0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:14.694160 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:14.730166 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-changed-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:14.730365 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Refreshing instance network info cache due to event network-changed-0f64a447-e138-44ea-b0f5-b984215bc61a. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:14.730526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] Acquiring lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:14.730620 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] Acquired lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:14.731537 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Refreshing network info cache for port 0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:14.836783 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:14.925677 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646014.9252753, 4b2f0d86-83ca-4a76-8950-cd2768dedf23 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:14.926982 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] VM Started (Lifecycle Event)
May 13 04:20:14.979660 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Creating config drive at /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.config
May 13 04:20:14.983700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp26n8ifc8 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.062237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp26n8ifc8" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.153466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:15.170860 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:15.172070 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:15.172302 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Creating image(s)
May 13 04:20:15.172975 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.173209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.173820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.174586 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:15.177818 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:15.181364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.235803 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:15.276641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.277141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.277743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.278534 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:15.282601 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:15.285233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.359946 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:15.393202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.393889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.430996 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:15.446919 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646015.4454744, 4b2f0d86-83ca-4a76-8950-cd2768dedf23 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:15.446919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] VM Paused (Lifecycle Event)
May 13 04:20:15.470850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk 1073741824" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.472986 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.473483 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.579700 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:15.580579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:15.617100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:15.629122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.155s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.629550 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:15.629759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:15.692484 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:15.743133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:15.744929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.745760 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.746122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.746604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] No event matching network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d in dict_keys([('network-vif-plugged', '24eb43dc-ba2c-41e4-8456-3af494301b3d')]) {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 04:20:15.746996 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received unexpected event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d for instance with vm_state building and task_state spawning.
May 13 04:20:15.747375 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:15.747659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.747904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.748068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.748823 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Processing event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:15.749222 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:15.749222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.749360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.749478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.749647 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:15.749814 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received unexpected event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with vm_state building and task_state spawning.
May 13 04:20:15.750189 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:15.751425 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:15.751646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:15.751879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.752080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.752377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.752497 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Processing event network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:15.754180 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Cannot resize image /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:15.755486 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:15.756378 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:15.756641 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Ensure instance console log exists: /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:15.756780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:15.758001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.758001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.758368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.759500 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:15.759500 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] No waiting events found dispatching network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:15.759593 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:15.759895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:15.760170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:15.760350 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-22ead39f-4999-4a60-ae5f-f46cedcf4bc8 req-205e8da8-8f47-496f-b1b1-c4240126ddf8 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received unexpected event network-vif-plugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 for instance with vm_state building and task_state spawning.
May 13 04:20:15.761359 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:15.768091 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance spawned successfully.
May 13 04:20:15.769492 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:15.770581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:15.778304 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance spawned successfully.
May 13 04:20:15.778713 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:15.953727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:15.958348 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646015.9579127, 63d8cb8c-e848-4309-8760-6e9646233b9e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:15.958531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] VM Resumed (Lifecycle Event)
May 13 04:20:16.082836 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-67b22a5b-be17-499a-9019-2015b644c3e4 req-6adbb395-2c5f-4a71-84f9-68d889cdb846 service nova] Releasing lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:16.083448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquired lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:16.083673 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:16.279511 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.279715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.280072 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.280524 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.280824 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.281228 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.292457 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.292721 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.293023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.293357 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.293643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.293974 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:16.462050 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:16.467384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:16.670563 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:16.788765 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Took 19.93 seconds to spawn the instance on the hypervisor.
May 13 04:20:16.789098 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:16.800213 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Took 9.89 seconds to spawn the instance on the hypervisor.
May 13 04:20:16.800379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:16.901571 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:16.971117 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:16.972151 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646016.971189, 4b2f0d86-83ca-4a76-8950-cd2768dedf23 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:16.972151 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] VM Resumed (Lifecycle Event)
May 13 04:20:17.083286 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Updating instance_info_cache with network_info: [{"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:17.301847 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Took 29.20 seconds to build instance.
May 13 04:20:17.315837 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Took 15.42 seconds to build instance.
May 13 04:20:17.475460 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:17.478226 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:17.586020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Releasing lock "refresh_cache-031c6b2f-ebe7-47e8-aa7c-e5345384cec9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:17.586020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance network_info: |[{"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:17.588826 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Start _get_guest_xml network_info=[{"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:17.593401 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:17.593401 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1562896071', uuid='031c6b2f-ebe7-47e8-aa7c-e5345384cec9'), owner=OwnerMeta(userid='dc9870910ccc42fe85fafc4b7facf3d0', username='tempest-ServersNegativeTestJSON-200158971-project-member', projectid='4a84b573397740d5b3723cedeea8afe6', projectname='tempest-ServersNegativeTestJSON-200158971'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646017.5922568) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:17.595477 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:17.595853 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:17.596791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:17.597053 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:17.600027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:17.600478 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:17.602383 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:17.622169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1562896071',display_name='tempest-ServersNegativeTestJSON-server-1562896071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1562896071',id=41,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-5y1dwjui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:14Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=031c6b2f-ebe7-47e8-aa7c-e5345384cec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:17.622836 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:17.623739 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:17.624644 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lazy-loading 'pci_devices' on Instance uuid 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:17.776263 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:17.804001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.723s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:17.804365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.708s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:17.804453 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:17.804553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:17.818135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44971371-03ed-49c6-86bc-929bb6282aeb tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.941s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:17.833242 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:17.833450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:17.833658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:17.836378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Processing event network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] No waiting events found dispatching network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:17.838923 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-84d37ea8-1c5c-440a-9c53-58de830e9f6e req-d0b10b6c-761d-4a56-9fa9-a206946571c2 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received unexpected event network-vif-plugged-24eb43dc-ba2c-41e4-8456-3af494301b3d for instance with vm_state building and task_state spawning.
May 13 04:20:17.839704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:17.850594 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:17.858708 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance spawned successfully.
May 13 04:20:17.859730 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:17.982090 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646017.9817398, e6cd15e9-77cc-41e7-81f9-839b352be4a5 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:17.982370 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] VM Started (Lifecycle Event)
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <uuid>031c6b2f-ebe7-47e8-aa7c-e5345384cec9</uuid>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <name>instance-00000029</name>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServersNegativeTestJSON-server-1562896071</nova:name>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:17</nova:creationTime>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:user uuid="dc9870910ccc42fe85fafc4b7facf3d0">tempest-ServersNegativeTestJSON-200158971-project-member</nova:user>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:project uuid="4a84b573397740d5b3723cedeea8afe6">tempest-ServersNegativeTestJSON-200158971</nova:project>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         <nova:port uuid="0f64a447-e138-44ea-b0f5-b984215bc61a">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="serial">031c6b2f-ebe7-47e8-aa7c-e5345384cec9</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="uuid">031c6b2f-ebe7-47e8-aa7c-e5345384cec9</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.config"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:b1:03:77"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <target dev="tap0f64a447-e1"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/console.log" append="off"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:18.129463 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Preparing to wait for external event network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:18.129463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:18.132822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1562896071',display_name='tempest-ServersNegativeTestJSON-server-1562896071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1562896071',id=41,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-5y1dwjui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:14Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=031c6b2f-ebe7-47e8-aa7c-e5345384cec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:18.132822 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:18.132822 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:18.132822 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:18.134193 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.134193 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:18.134193 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:18.134751 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.134917 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e0645ed-bfab-5afd-87a7-1e262148ad73', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:18.138717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.139643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:18.141877 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.142055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f64a447-e1, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:18.142507 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f64a447-e1, col_values=(('qos', UUID('0326bd06-0c29-4cab-9e53-dc2e767d41ab')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:18.142720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f64a447-e1, col_values=(('external_ids', {'iface-id': '0f64a447-e138-44ea-b0f5-b984215bc61a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:03:77', 'vm-uuid': '031c6b2f-ebe7-47e8-aa7c-e5345384cec9'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:18.144516 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.147900 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:18.151493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.151493 np0000000669 nova-compute[97951]: INFO os_vif [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1')
May 13 04:20:18.196019 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:18.196570 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:18.196750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:18.196889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:18.197005 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:18.199592 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Terminating instance
May 13 04:20:18.367808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.368052 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.368545 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.369048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.370476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.370476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:18.489861 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:18.492997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:18.706373 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:20:18.730937 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.735940 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.756575 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.761463 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.789769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.799390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:18.877441 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Took 9.31 seconds to spawn the instance on the hypervisor.
May 13 04:20:18.878022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:18.997694 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:18.997792 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646018.9976032, e6cd15e9-77cc-41e7-81f9-839b352be4a5 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:18.997970 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] VM Paused (Lifecycle Event)
May 13 04:20:19.032951 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.071774 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Instance destroyed successfully.
May 13 04:20:19.074088 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 63d8cb8c-e848-4309-8760-6e9646233b9e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:19.083759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.083759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.108151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.388026 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Took 14.88 seconds to build instance.
May 13 04:20:19.424744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.440122 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.445346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.481463 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.497041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.501579 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:19.505406 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646019.5050323, e6cd15e9-77cc-41e7-81f9-839b352be4a5 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:19.505715 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] VM Resumed (Lifecycle Event)
May 13 04:20:19.579645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1538922557',display_name='tempest-TestVolumeBootPattern-server-1538922557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1538922557',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:16Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-pwdht8hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:17Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=63d8cb8c-e848-4309-8760-6e9646233b9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:20:19.579875 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "address": "fa:16:3e:9f:8c:84", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2854bb9b-b5", "ovs_interfaceid": "2854bb9b-b5ae-44d4-acbb-b6fb68cb7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:19.580387 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:19.580602 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:20:19.582417 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.583816 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2854bb9b-b5, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:19.585955 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.587145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:19.595224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.596730 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.598379 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47202c6a-f280-4fd7-9070-428926b1ead6) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:19.599732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.599732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:19.611354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.617589 np0000000669 nova-compute[97951]: INFO os_vif [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:8c:84,bridge_name='br-int',has_traffic_filtering=True,id=2854bb9b-b5ae-44d4-acbb-b6fb68cb7119,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2854bb9b-b5')
May 13 04:20:19.621524 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:20:19.622107 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:19.623160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:19.624116 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:19.624645 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea7340e8-8978-474d-a38c-1ee50640489f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:20:19.624931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:20:19.649847 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f (non-flash)
May 13 04:20:19.667355 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', '92')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:20:19.667355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', '92')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:20:19.668160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f', '91')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:20:19.668555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46481e7600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:20:19.668749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:20:19.668999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 33000000020699b22 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:20:19.680397 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.688049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:19.689470 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:19.689470 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No VIF found with MAC fa:16:3e:b1:03:77, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:19.689470 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Using config drive
May 13 04:20:19.693131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.697717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:19.704499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:20:19.763996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:20:19.816507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:20:19.816507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:20:19.816915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:20:19.837368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:20:19.837641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:20:19.852170 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:19.892165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff00b2ab-d997-4ad7-b061-3f4c22e7798f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.388s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:19.895798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.40.100,3260]
May 13 04:20:19.895798 np0000000669 nova-compute[97951]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.40.100,3260] successful.
May 13 04:20:19.895798 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:19.916340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:19.931164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:19.939939 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:19.940169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:19.940396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:19.940557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:19.940724 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:19.940884 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:19.941027 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-changed-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:19.941160 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Refreshing instance network info cache due to event network-changed-48a2ef47-e423-4089-94cb-2fbecdbcab81. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:19.941343 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquiring lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:19.941484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquired lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:19.941623 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Refreshing network info cache for port 48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:19.982222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.50.100,3260]
May 13 04:20:19.982222 np0000000669 nova-compute[97951]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ea7340e8-8978-474d-a38c-1ee50640489f, portal: 192.168.50.100,3260] successful.
May 13 04:20:19.982222 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:20.004822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:20.006607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:20.006742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (385ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:20.006927 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:20:20.007075 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Deleting instance files /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e_del
May 13 04:20:20.007754 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Deletion of /opt/stack/data/nova/instances/63d8cb8c-e848-4309-8760-6e9646233b9e_del complete
May 13 04:20:20.012573 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:20.020078 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:20.197400 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:20.354487 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Creating config drive at /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.config
May 13 04:20:20.358242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpilqqz4di {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:20.424880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpilqqz4di" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:20.449367 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:20.529413 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998465401999965 future=<Future at 0x7a46484501a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:20.530094 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997397129000092 future=<Future at 0x7a46484501a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:20.530259 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997201041999688 future=<Future at 0x7a46484501a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:20.536380 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Took 1.83 seconds to destroy the instance on the hypervisor.
May 13 04:20:20.536638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:20.539189 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:20:20.543350 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:20:20.544017 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:20:20.544596 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:20.632662 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:20.700672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:20.700672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing instance network info cache due to event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:20.700854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] Acquiring lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:20.700897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] Acquired lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:20.702172 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing network info cache for port 24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:20.957017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:20.997259 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:21.046352 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:21.136766 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:21.204448 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:21.338181 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:21.341825 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a3aac984-1217-46c1-8757-119bb8db89e7 req-991188a0-3903-417d-8276-8020593dab98 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:21.356456 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a3aac984-1217-46c1-8757-119bb8db89e7 req-991188a0-3903-417d-8276-8020593dab98 service nova] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:21.356456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:21.359126 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a3aac984-1217-46c1-8757-119bb8db89e7 req-991188a0-3903-417d-8276-8020593dab98 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:21.360717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a3aac984-1217-46c1-8757-119bb8db89e7 req-991188a0-3903-417d-8276-8020593dab98 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:21.365955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a3aac984-1217-46c1-8757-119bb8db89e7 req-991188a0-3903-417d-8276-8020593dab98 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Processing event network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:21.384701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:21.404311 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:21.463215 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updated VIF entry in instance network info cache for port 48a2ef47-e423-4089-94cb-2fbecdbcab81. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:21.463215 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating instance_info_cache with network_info: [{"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:21.907304 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Took 1.36 seconds to deallocate network for instance.
May 13 04:20:21.915067 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:21.966801 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Releasing lock "refresh_cache-4b2f0d86-83ca-4a76-8950-cd2768dedf23" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:21.967227 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:21.967517 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:21.967743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:21.967918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:21.968105 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:21.970116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:21.970659 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received unexpected event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with vm_state active and task_state deleting.
May 13 04:20:21.970860 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:21.971396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:21.971591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:21.971744 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:21.971899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:21.972061 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3fb87673-f25c-49a9-a7cf-e7c2f2cfeacb req-ab4e7599-568e-4cd4-bc6e-9c2d31f69b3e service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received unexpected event network-vif-plugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with vm_state active and task_state deleting.
May 13 04:20:22.050231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:22.050731 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:22.052301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:22.052653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:22.052830 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:22.052928 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:22.053097 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:22.053157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Acquiring lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:22.055416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:22.055788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:22.055936 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] No waiting events found dispatching network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:22.056049 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-unplugged-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:22.056237 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fb77aa87-1af3-48d5-ad93-8b8b6bae2c99 req-ca85988b-c978-4455-b489-d0878fdc18f0 service nova] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Received event network-vif-deleted-2854bb9b-b5ae-44d4-acbb-b6fb68cb7119 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:22.208569 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updated VIF entry in instance network info cache for port 24eb43dc-ba2c-41e4-8456-3af494301b3d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:22.210364 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:22.242784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:22.244108 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646022.2433767, 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:22.244108 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] VM Started (Lifecycle Event)
May 13 04:20:22.249938 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:22.256910 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance spawned successfully.
May 13 04:20:22.256910 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:22.501552 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Took 0.59 seconds to detach 1 volumes for instance.
May 13 04:20:22.600204 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:22.600612 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:20:22.660770 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:22.660936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:22.715797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-805682bf-c0e4-44da-8140-46e730cf003b req-82d12763-7f86-4f08-a947-73f805dd1d72 service nova] Releasing lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:22.746304 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:22.748918 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:22.765257 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.765501 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.765989 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.766342 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.766758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.767094 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:22.881499 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:23.014468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:23.014992 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:23.085214 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:23.085701 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:20:23.165284 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:23.252412 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:23.252863 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646023.2522616, 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:23.252863 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] VM Paused (Lifecycle Event)
May 13 04:20:23.272682 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Took 8.10 seconds to spawn the instance on the hypervisor.
May 13 04:20:23.273621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:23.424696 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:23.424696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:23.424696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:23.424820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:23.425375 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] No waiting events found dispatching network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:23.426840 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-4850c424-9b13-4c0d-b697-46de9e5c82ab req-dc9f3dbd-b0d9-409a-bf7a-8e3ef41ee59c service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received unexpected event network-vif-plugged-0f64a447-e138-44ea-b0f5-b984215bc61a for instance with vm_state active and task_state None.
May 13 04:20:23.533095 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:23.533095 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:23.757459 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:23.759306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:23.761598 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646023.761313, 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:23.761706 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] VM Resumed (Lifecycle Event)
May 13 04:20:23.799712 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Took 13.76 seconds to build instance.
May 13 04:20:24.036929 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:24.083998 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:24.264054 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:24.266503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:24.301870 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-781defe1-332e-4196-ba08-41ad1d79cb9f tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.280s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:24.550818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.536s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:24.557420 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.798s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:24.566600 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:24.568756 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Claim successful on node np0000000669
May 13 04:20:24.588395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:24.602427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:24.631266 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 63d8cb8c-e848-4309-8760-6e9646233b9e
May 13 04:20:24.699497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:25.214486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:25.214973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:25.644349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df05b40d-d96a-4d6b-921e-59a253d18f70 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "63d8cb8c-e848-4309-8760-6e9646233b9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.445s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:25.719013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:26.016091 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:26.016274 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:26.193347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:26.301484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:26.521245 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:27.031187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.474s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:27.033171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.444s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:27.033467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:27.033902 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:20:27.034141 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:27.037204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.733s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:27.044032 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:27.046794 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Claim successful on node np0000000669
May 13 04:20:27.540936 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:27.542125 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:27.542590 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:27.542804 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:27.638803 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:27.780830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:27.781021 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:28.022450 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:28.042744 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:28.093362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.231504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.232084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.255428 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Successfully created port: 55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:28.284784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:28.390509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.398274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.548597 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:28.553678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.554183 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.685463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.691390 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:20:28.696911 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:20:28.699037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.826011 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.827782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:28.866599 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:28.867119 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:28.909781 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:28.952112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:28.957302 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:28.961513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:29.030339 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Successfully updated port: 55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:29.036103 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:29.036768 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12610MB free_disk=73.12536239624023GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:20:29.037023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:29.087746 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:29.087746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:29.087746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:29.087922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:29.088158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] No waiting events found dispatching network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:29.088374 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-52947387-8f52-46ca-9542-7680a3781ee9 req-5591ed3e-c61d-4bc1-bbb8-d6ca8080360b service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received unexpected event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 for instance with vm_state building and task_state block_device_mapping.
May 13 04:20:29.111045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:29.111176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing instance network info cache due to event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:29.111377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] Acquiring lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:29.111489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] Acquired lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:29.111604 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing network info cache for port 55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:29.380379 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:29.542077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:29.584393 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:29.584961 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:29.585187 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Creating image(s)
May 13 04:20:29.589958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:29.590120 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:29.590694 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:29.591841 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:29.597650 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:29.599090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:29.615221 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:29.619613 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:29.710799 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:29.761924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:29.761924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:29.765745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.167s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:29.767844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:29.768998 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:29.769477 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:29.774753 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:29.774996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:29.804500 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:29.889905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.856s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:29.890772 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:29.900718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.991s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:29.903625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:29.905336 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:29.926309 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:29.945447 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:29.946125 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Claim successful on node np0000000669
May 13 04:20:29.990350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk 1073741824" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:29.990896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:29.991573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:30.090012 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:30.096404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:30.100346 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:30.100346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:30.190003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Ensure instance console log exists: /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:30.192289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:30.265625 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:30.409666 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:30.409804 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:30.412570 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:30.412804 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:30.533098 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc9870910ccc42fe85fafc4b7facf3d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a84b573397740d5b3723cedeea8afe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:30.593041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e9513105-6880-48f7-81eb-c20c9347f1ba req-479a6277-c5fc-46b3-b916-1938249a840f service nova] Releasing lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:30.593636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:30.593837 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:30.842597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:30.909806 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:30.995143 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Successfully created port: e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:31.184074 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:31.418997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:31.460541 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:31.663779 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:31.664297 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:31.708535 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Successfully updated port: e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:31.751772 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:31.790429 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-changed-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:31.791314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Refreshing instance network info cache due to event network-changed-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:31.791613 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] Acquiring lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:31.791791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] Acquired lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:31.792018 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Refreshing network info cache for port e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:32.167399 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:32.211447 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:32.254269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:32.254853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance network_info: |[{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:32.256844 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Start _get_guest_xml network_info=[{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:32.259961 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:32.261168 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='bb3874f1-4ceb-4a94-9d9e-e388fb6a3400'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646032.2608354) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:32.262336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:32.262704 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:32.263610 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:32.263806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:32.264645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:32.264978 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:32.265153 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:32.265271 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:32.265431 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:32.265551 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:32.265688 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:32.265978 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:32.265978 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:32.266135 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:32.266233 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:32.266574 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:32.280062 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=42,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-z0q5wxx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bb3874f1-4ceb-4a94-9d9e-e388fb6a3400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:32.280230 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:32.281084 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:32.281686 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:32.300085 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:32.356127 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:32.434741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:32.435652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:32.435892 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Creating image(s)
May 13 04:20:32.436338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:32.436521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:32.440165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:32.440858 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:32.444674 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:32.450154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:32.541481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:32.544134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:32.544744 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:32.545384 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:32.554288 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:32.560523 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:32.560806 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:32.648825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:32.649901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:32.682026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.781s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:32.683175 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:32.687023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.645s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:32.714848 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk 1073741824" returned: 0 in 0.065s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:32.718532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:32.718532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:32.787490 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <uuid>bb3874f1-4ceb-4a94-9d9e-e388fb6a3400</uuid>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <name>instance-0000002a</name>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-1</nova:name>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:32</nova:creationTime>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         <nova:port uuid="55e9c21b-9829-40e1-98cc-037540f69e41">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="serial">bb3874f1-4ceb-4a94-9d9e-e388fb6a3400</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="uuid">bb3874f1-4ceb-4a94-9d9e-e388fb6a3400</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.config"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:e3:02:55"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <target dev="tap55e9c21b-98"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/console.log" append="off"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:32.787490 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:32.787490 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Preparing to wait for external event network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=42,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-z0q5wxx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bb3874f1-4ceb-4a94-9d9e-e388fb6a3400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:32.793619 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:32.794209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.794423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:32.794767 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:32.795595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.795786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c477b73e-b8d2-524b-97ab-2eb7d1b82681', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:32.796738 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.800060 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:32.802126 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.802276 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55e9c21b-98, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:32.802783 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55e9c21b-98, col_values=(('qos', UUID('6e5dd808-432f-4925-928d-796b5bc36ac9')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:32.802984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55e9c21b-98, col_values=(('external_ids', {'iface-id': '55e9c21b-9829-40e1-98cc-037540f69e41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:02:55', 'vm-uuid': 'bb3874f1-4ceb-4a94-9d9e-e388fb6a3400'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:32.805140 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.806452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:32.814744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:32.816909 np0000000669 nova-compute[97951]: INFO os_vif [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98')
May 13 04:20:32.841709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.125s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:32.842525 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:32.842822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:32.970977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:32.971962 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Cannot resize image /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:32.974979 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:32.974979 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Ensure instance console log exists: /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:32.974979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:32.974979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:32.974979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:33.060282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b8f1e7d-7727-4b5a-9676-953ed2c0bf2e req-ef14ca77-90de-4b3e-b77c-666e43489902 service nova] Releasing lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:33.061621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquired lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:33.061621 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:33.194035 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:33.194239 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:33.194954 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:33.194954 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:33.301102 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4020376a6d94b8f88c2e952c7a198ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016554a7d54c4781a53b6ddb1f2e81e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:33.346224 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:33.346465 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:33.645301 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:33.705384 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance fd379e34-a21d-45c7-99e6-6f77272bc1ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 081ed429-cdf3-42b2-81df-a9c3b8e39a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.796372 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:20:33.824531 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Successfully created port: e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:33.853547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:33.903359 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:34.116935 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Updating instance_info_cache with network_info: [{"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:34.213109 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:34.299316 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 964efe52-53ac-408f-a011-b8e49c5b6fd4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 04:20:34.370619 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:34.371392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:34.371572 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:e3:02:55, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:34.373363 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Using config drive
May 13 04:20:34.422099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:34.469636 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Successfully updated port: e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:34.544929 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-changed-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:34.544929 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Refreshing instance network info cache due to event network-changed-e01dce11-aaaa-49cd-81e5-1f6dfb18da99. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:34.544929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] Acquiring lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:34.544929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] Acquired lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:34.545117 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Refreshing network info cache for port e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:34.618670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Releasing lock "refresh_cache-081ed429-cdf3-42b2-81df-a9c3b8e39a9c" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:34.618896 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance network_info: |[{"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:34.622962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Start _get_guest_xml network_info=[{"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:34.633011 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:34.634304 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1578686957', uuid='081ed429-cdf3-42b2-81df-a9c3b8e39a9c'), owner=OwnerMeta(userid='dc9870910ccc42fe85fafc4b7facf3d0', username='tempest-ServersNegativeTestJSON-200158971-project-member', projectid='4a84b573397740d5b3723cedeea8afe6', projectname='tempest-ServersNegativeTestJSON-200158971'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646034.6338525) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:34.635746 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:34.636151 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:34.637525 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:34.637754 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:34.638811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:34.639084 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:34.639252 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:34.639335 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:34.639516 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:34.639601 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:34.639699 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:34.639848 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:34.639993 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:34.640112 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:34.640508 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:34.640671 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:34.652994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1578686957',display_name='tempest-ServersNegativeTestJSON-server-1578686957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1578686957',id=43,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-0dn0it59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:31Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=081ed429-cdf3-42b2-81df-a9c3b8e39a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:34.653431 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:34.654287 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:34.654980 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lazy-loading 'pci_devices' on Instance uuid 081ed429-cdf3-42b2-81df-a9c3b8e39a9c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:34.717354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:34.803696 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 04:20:34.807350 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:20:34.807350 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:20:29 up 34 min,  2 users,  load average: 9.06, 7.77, 4.52\n', 'num_instances': '8', 'num_vm_active': '5', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '3', 'io_workload': '3', 'num_proj_15743507272b4687a350f2974d99a4ae': '1', 'num_proj_4c06d9163829483dafb7a6dcd1a3f194': '1', 'num_proj_4a84b573397740d5b3723cedeea8afe6': '2', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_016554a7d54c4781a53b6ddb1f2e81e2': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:20:34.880071 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:34.972766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:35.047410 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:35.059887 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Creating config drive at /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.config
May 13 04:20:35.068884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr82nel4z {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.146832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr82nel4z" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.159345 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <uuid>081ed429-cdf3-42b2-81df-a9c3b8e39a9c</uuid>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <name>instance-0000002b</name>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:name>tempest-ServersNegativeTestJSON-server-1578686957</nova:name>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:34</nova:creationTime>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:user uuid="dc9870910ccc42fe85fafc4b7facf3d0">tempest-ServersNegativeTestJSON-200158971-project-member</nova:user>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:project uuid="4a84b573397740d5b3723cedeea8afe6">tempest-ServersNegativeTestJSON-200158971</nova:project>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         <nova:port uuid="e53fdc53-1e17-4cbd-95bb-8efce5b2ae95">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="serial">081ed429-cdf3-42b2-81df-a9c3b8e39a9c</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="uuid">081ed429-cdf3-42b2-81df-a9c3b8e39a9c</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.config"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:e6:cf:6e"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <target dev="tape53fdc53-1e"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/console.log" append="off"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:35.159345 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:35.162508 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Preparing to wait for external event network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:35.162508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:35.162508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:35.162508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:35.163343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1578686957',display_name='tempest-ServersNegativeTestJSON-server-1578686957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1578686957',id=43,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-0dn0it59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:31Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=081ed429-cdf3-42b2-81df-a9c3b8e39a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:35.163343 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:35.166346 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:35.166346 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:35.166346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.166346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:35.166346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:35.167460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.167764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '796b015b-2f55-53c0-bc58-09c20cc05f09', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:35.168724 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.171025 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:35.177739 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:35.179758 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.183146 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.183423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape53fdc53-1e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:35.184032 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape53fdc53-1e, col_values=(('qos', UUID('bdc4da2d-cee3-4723-bb1c-cdbd819d4584')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:35.184533 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape53fdc53-1e, col_values=(('external_ids', {'iface-id': 'e53fdc53-1e17-4cbd-95bb-8efce5b2ae95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:cf:6e', 'vm-uuid': '081ed429-cdf3-42b2-81df-a9c3b8e39a9c'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:35.185843 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.189484 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:35.200544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.202487 np0000000669 nova-compute[97951]: INFO os_vif [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e')
May 13 04:20:35.231037 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:35.231037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:35.231037 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Creating image(s)
May 13 04:20:35.233629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:35.234040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:35.235669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:35.235669 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:35.239339 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:35.240847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.373868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.375353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:35.375353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:35.376850 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:35.381209 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:35.382966 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.463312 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:35.528163 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005673549999301031 future=<Future at 0x7a46484501a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:35.528163 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:35.530552 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Emitting event <LifecycleEvent: 1778646020.5273798, 63d8cb8c-e848-4309-8760-6e9646233b9e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:35.530725 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] VM Stopped (Lifecycle Event)
May 13 04:20:35.536807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.154s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.536807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.639997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk 1073741824" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.641362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:35.641362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.682541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:35.682914 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:35.750056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.752197 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:35.752350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:35.804473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:35.804899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:35.805929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:35.806742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:35.806988 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] No waiting events found dispatching network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:35.807440 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-428cbd41-648b-4eff-98f2-52e026f0e907 req-8c473272-8d33-4d64-b035-5027b3ec5587 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received unexpected event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 for instance with vm_state building and task_state spawning.
May 13 04:20:35.809004 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.883700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:35.884027 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Cannot resize image /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:35.884404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:35.884778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:35.885090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:35.885281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:35.885786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:35.911491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.941721 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.950458 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:35.967387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08b0e5c-f3e0-4822-bcf3-d4b6371232b4 req-8cb4c95e-5211-4a13-b5cc-5b91eb8ebd48 service nova] Releasing lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:35.967669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquired lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:35.967859 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:36.037137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 63d8cb8c-e848-4309-8760-6e9646233b9e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:36.188406 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:36.567355 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:36.700381 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:20:36.700381 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.017s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:36.701561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.859s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:36.701857 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:20:36.711140 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:36.711335 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Claim successful on node np0000000669
May 13 04:20:36.749656 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:36.750310 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:36.750310 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] No VIF found with MAC fa:16:3e:e6:cf:6e, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:36.754889 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Using config drive
May 13 04:20:36.755948 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:36.790247 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646036.7896612, bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:36.790247 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] VM Started (Lifecycle Event)
May 13 04:20:36.979058 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating instance_info_cache with network_info: [{"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:37.265276 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:37.293167 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:37.295467 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646037.2946393, bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:37.295467 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] VM Paused (Lifecycle Event)
May 13 04:20:37.413113 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Creating config drive at /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.config
May 13 04:20:37.417069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqp44h4sk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:37.482572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Releasing lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:37.483304 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance network_info: |[{"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:37.485792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Start _get_guest_xml network_info=[{"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:37.486631 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqp44h4sk" returned: 0 in 0.069s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:37.492759 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:37.494626 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-265770418', uuid='dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9'), owner=OwnerMeta(userid='e4020376a6d94b8f88c2e952c7a198ee', username='tempest-VolumesBackupsTest-986605255-project-member', projectid='016554a7d54c4781a53b6ddb1f2e81e2', projectname='tempest-VolumesBackupsTest-986605255'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646037.4941378) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:37.496648 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:37.497097 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:37.498384 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:37.498645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:37.499918 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:37.500384 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:37.500691 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:37.500691 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:37.500935 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:37.501141 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:37.501141 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:37.501346 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:37.504017 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:37.504210 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:37.504405 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:37.504590 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:37.522004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-265770418',display_name='tempest-VolumesBackupsTest-instance-265770418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-265770418',id=44,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8kBMq8ErmYFGtVMZNH7XnUJ65yQOm8GDHmTrpcdgG1nt9fXMaA/8zYH5OnvnTErTnX3uHlLOEjUfSXbZI9DguftpPBhssPqRhFURwP7rLfvn6myTJqZX/M6alvLVqduA==',key_name='tempest-keypair-1495567488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-9zo0uj86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:37.522365 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:37.522784 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:37.523301 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'pci_devices' on Instance uuid dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:37.699288 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:37.700335 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:37.700651 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:37.700930 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:37.701203 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:20:37.701382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:20:37.701718 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.38 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:20:37.799701 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:37.807480 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:37.873868 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Processing event network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] No waiting events found dispatching network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:37.877115 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-cdcd6b72-cee5-4027-bebe-99b78c997a01 req-041c6486-8560-4cab-911b-a91c8117b3b8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received unexpected event network-vif-plugged-55e9c21b-9829-40e1-98cc-037540f69e41 for instance with vm_state building and task_state spawning.
May 13 04:20:37.878073 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:37.884743 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:37.890132 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance spawned successfully.
May 13 04:20:37.894820 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:37.967784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.011749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.028835 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <uuid>dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9</uuid>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <name>instance-0000002c</name>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesBackupsTest-instance-265770418</nova:name>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:37</nova:creationTime>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:user uuid="e4020376a6d94b8f88c2e952c7a198ee">tempest-VolumesBackupsTest-986605255-project-member</nova:user>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:project uuid="016554a7d54c4781a53b6ddb1f2e81e2">tempest-VolumesBackupsTest-986605255</nova:project>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         <nova:port uuid="e01dce11-aaaa-49cd-81e5-1f6dfb18da99">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="serial">dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="uuid">dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.config"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:13:12:82"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <target dev="tape01dce11-aa"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/console.log" append="off"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:38.028835 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:38.031423 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Preparing to wait for external event network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:38.031423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:38.031423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:38.031423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:38.035277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-265770418',display_name='tempest-VolumesBackupsTest-instance-265770418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-265770418',id=44,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8kBMq8ErmYFGtVMZNH7XnUJ65yQOm8GDHmTrpcdgG1nt9fXMaA/8zYH5OnvnTErTnX3uHlLOEjUfSXbZI9DguftpPBhssPqRhFURwP7rLfvn6myTJqZX/M6alvLVqduA==',key_name='tempest-keypair-1495567488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-9zo0uj86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:38.035550 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:38.036393 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:38.036810 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:38.038863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.039136 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:38.039435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:38.040619 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.040674 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f22ef1d8-68e9-5084-8023-cf2127c779a6', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:38.044294 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:38.101515 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.104409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.111613 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.111613 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape01dce11-aa, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:38.111810 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape01dce11-aa, col_values=(('qos', UUID('fa12c862-4e7b-4aa2-b36f-169276bdb7cb')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:38.112064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape01dce11-aa, col_values=(('external_ids', {'iface-id': 'e01dce11-aaaa-49cd-81e5-1f6dfb18da99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:12:82', 'vm-uuid': 'dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:38.112952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.114489 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:38.124827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.127032 np0000000669 nova-compute[97951]: INFO os_vif [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa')
May 13 04:20:38.207928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.215462 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:38.310202 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:38.310566 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646038.3103557, bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:38.310671 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] VM Resumed (Lifecycle Event)
May 13 04:20:38.414368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.414368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.415404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.415404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.416134 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.417091 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:38.477690 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:38.478046 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:38.532979 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ee8b2736-3dd2-4366-b729-834185f81a3d req-b59f4ca3-f2c6-46f9-88eb-f7564ea58f89 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:38.532979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee8b2736-3dd2-4366-b729-834185f81a3d req-b59f4ca3-f2c6-46f9-88eb-f7564ea58f89 service nova] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:38.533162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee8b2736-3dd2-4366-b729-834185f81a3d req-b59f4ca3-f2c6-46f9-88eb-f7564ea58f89 service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:38.533162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee8b2736-3dd2-4366-b729-834185f81a3d req-b59f4ca3-f2c6-46f9-88eb-f7564ea58f89 service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:38.533280 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ee8b2736-3dd2-4366-b729-834185f81a3d req-b59f4ca3-f2c6-46f9-88eb-f7564ea58f89 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Processing event network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:38.812874 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:38.818619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:38.924474 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Took 9.34 seconds to spawn the instance on the hypervisor.
May 13 04:20:38.924620 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:38.985064 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:39.042714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:39.046248 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:39.048585 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance spawned successfully.
May 13 04:20:39.048912 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:39.324863 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:39.325211 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646039.324952, 081ed429-cdf3-42b2-81df-a9c3b8e39a9c => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:39.325564 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] VM Started (Lifecycle Event)
May 13 04:20:39.438078 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Took 15.76 seconds to build instance.
May 13 04:20:39.494288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.793s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:39.494451 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:39.496878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.075s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:39.500898 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:39.500898 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Claim successful on node np0000000669
May 13 04:20:39.563885 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.564515 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.564806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.565064 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.565355 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.565631 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:39.673605 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:39.673819 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:39.674840 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No VIF found with MAC fa:16:3e:13:12:82, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:39.675779 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Using config drive
May 13 04:20:39.716661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:39.828074 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:39.832306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:39.940559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7ed5d62d-4d14-4393-9aea-9fe9d0b148e3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.279s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:40.001158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:40.001367 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:40.001691 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:40.001951 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:40.070821 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Took 7.64 seconds to spawn the instance on the hypervisor.
May 13 04:20:40.071045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:40.089679 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:40.182258 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:40.287106 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:40.334831 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:40.335529 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646040.3350756, 081ed429-cdf3-42b2-81df-a9c3b8e39a9c => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:40.335529 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] VM Paused (Lifecycle Event)
May 13 04:20:40.501223 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Creating config drive at /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.config
May 13 04:20:40.501223 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:40.509251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2i71zci {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:40.582303 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Took 14.36 seconds to build instance.
May 13 04:20:40.583818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2i71zci" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:40.642390 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:40.642773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:40.643023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:40.643351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:40.649473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] No waiting events found dispatching network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:40.649718 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-87d672da-cbff-4184-b08b-c5ca874edd33 req-9b011b91-b407-433f-98b4-a923ac81dafc service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received unexpected event network-vif-plugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 for instance with vm_state active and task_state None.
May 13 04:20:40.722225 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:40.722590 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing instance network info cache due to event network-changed-24eb43dc-ba2c-41e4-8456-3af494301b3d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:40.723340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] Acquiring lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:40.723340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] Acquired lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:40.723340 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Refreshing network info cache for port 24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:40.840434 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:40.846997 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646040.8466325, 081ed429-cdf3-42b2-81df-a9c3b8e39a9c => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:40.847153 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] VM Resumed (Lifecycle Event)
May 13 04:20:40.859530 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Successfully created port: dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:41.009228 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:41.089394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4dbc0555-bafd-4fde-8efa-fab9dd157b95 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.874s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:41.190583 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.218557 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.221425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.226934 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:41.251113 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:41.251398 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:41.355989 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:41.359604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:41.366619 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.515076 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Booting with volume df05c3fb-3e8d-4128-ace3-ba428e14e2ee at /dev/vda
May 13 04:20:41.589097 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:41.608628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:20:41.634374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.645115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.649507 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:41.677943 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:41.708728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:20:41.709715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:20:41.721125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:20:41.723103 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:feb1:377', 'fe80::bc99:21ff:fee9:c7a7', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fee6:cf6e', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962'] 
May 13 04:20:41.723417 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:20:41.723692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:20:41.727350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:41.727350 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updating existing volume attachment record: b8522926-9795-45eb-a9fb-c717a7d10b60 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:20:41.740501 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Successfully updated port: dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:41.747482 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:41.755899 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:41.835512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:41.835512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:41.835512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:41.835512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:41.835512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:41.838349 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Terminating instance
May 13 04:20:41.866532 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 04:20:41.920866 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updated VIF entry in instance network info cache for port 24eb43dc-ba2c-41e4-8456-3af494301b3d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:41.921451 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [{"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:42.251147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:42.251580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:42.251580 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:42.269196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.772s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:42.269196 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:42.341919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:20:42.349676 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646042.349342, dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:42.349840 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] VM Started (Lifecycle Event)
May 13 04:20:42.393303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.423888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b88d7697-87b5-4b07-bb51-c1ee1d92e5f6 req-9e44bac6-965b-4b10-b2f2-6ff2cd56fda6 service nova] Releasing lock "refresh_cache-e6cd15e9-77cc-41e7-81f9-839b352be4a5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:42.435063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.535499 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.541550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.661761 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.678182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.697202 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Instance destroyed successfully.
May 13 04:20:42.699400 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lazy-loading 'resources' on Instance uuid 081ed429-cdf3-42b2-81df-a9c3b8e39a9c {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:42.708768 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1578686957',display_name='tempest-ServersNegativeTestJSON-server-1578686957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1578686957',id=43,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:40Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-0dn0it59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:40Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=081ed429-cdf3-42b2-81df-a9c3b8e39a9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:20:42.712862 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "address": "fa:16:3e:e6:cf:6e", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape53fdc53-1e", "ovs_interfaceid": "e53fdc53-1e17-4cbd-95bb-8efce5b2ae95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:42.712862 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:42.712862 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:20:42.715341 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.715574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape53fdc53-1e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:42.716530 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.718114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.719505 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.719505 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdc4da2d-cee3-4723-bb1c-cdbd819d4584) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:42.720192 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.720690 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:42.721137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:42.723108 np0000000669 nova-compute[97951]: INFO os_vif [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:cf:6e,bridge_name='br-int',has_traffic_filtering=True,id=e53fdc53-1e17-4cbd-95bb-8efce5b2ae95,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53fdc53-1e')
May 13 04:20:42.723509 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Deleting instance files /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c_del
May 13 04:20:42.724432 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Deletion of /opt/stack/data/nova/instances/081ed429-cdf3-42b2-81df-a9c3b8e39a9c_del complete
May 13 04:20:42.751067 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-changed-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:42.751550 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Refreshing instance network info cache due to event network-changed-dac0b6db-f515-440b-a43a-889f6544d3ce. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:42.751684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Acquiring lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:42.784623 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:42.784623 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:42.784623 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:42.784623 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:42.808291 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:42.808852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:42.817941 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:42.818515 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing instance network info cache due to event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:42.818729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] Acquiring lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:42.818916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] Acquired lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:42.818999 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing network info cache for port 55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:42.846464 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:42.852219 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:42.856365 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646042.8560505, dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:42.858157 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] VM Paused (Lifecycle Event)
May 13 04:20:42.908268 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '434adac2000c4da29488decad2034361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e227d582564c4ef7b5ab8d19583df520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:43.046705 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:43.188299 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updating instance_info_cache with network_info: [{"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:43.232912 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Took 0.89 seconds to destroy the instance on the hypervisor.
May 13 04:20:43.235795 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:20:43.235795 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:20:43.235975 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:20:43.236245 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:43.293303 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:43.314600 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:43.322553 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:43.334849 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:43.361214 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:43.366697 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:43.470747 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Successfully created port: a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:43.691121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:43.691252 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Instance network_info: |[{"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:43.691467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Acquired lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:43.691596 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Refreshing network info cache for port dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:43.796442 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:43.869096 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:43.869531 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999771182000131 future=<Future at 0x7a4648223e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:43.869863 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999433981000038 future=<Future at 0x7a4648223e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:43.869971 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999302566000097 future=<Future at 0x7a4648223e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:43.890681 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:43.891504 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:43.891764 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Creating image(s)
May 13 04:20:43.892014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:20:43.892142 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Ensure instance console log exists: /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:43.893510 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:43.895408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:43.898963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:43.899822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Start _get_guest_xml network_info=[{"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '964efe52-53ac-408f-a011-b8e49c5b6fd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'serial': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee'}, 'disk_bus': 'virtio', 'attachment_id': 'b8522926-9795-45eb-a9fb-c717a7d10b60', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:43.905404 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:43.906750 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1206642519', uuid='964efe52-53ac-408f-a011-b8e49c5b6fd4'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646043.90628) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:43.908049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:43.908364 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:43.910944 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:43.911221 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:43.912452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:43.912841 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:43.912991 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:43.913126 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:43.913249 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:43.913397 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:43.913571 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:43.914407 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:43.914407 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:43.914407 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:43.914407 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:43.914407 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:43.930541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:20:43.931111 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:43.931451 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:43.931864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:43.932187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:20:43.946915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:43.947494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:43.947990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:43.948241 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:43.948742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:43.948931 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:43.956162 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:43.962415 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:43.962415 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:43.969210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:43.969210 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:43.977902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee] added
May 13 04:20:43.977902 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:43.977902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:43.977902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:43.977902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:43.977902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:43.977902 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:43.978134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:43.978311 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:43.978568 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee] added
May 13 04:20:43.984547 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:43.984547 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:43.984547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:43.984806 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:43.984964 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:44.086952 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Successfully updated port: a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:44.127066 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:44.134208 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updated VIF entry in instance network info cache for port 55e9c21b-9829-40e1-98cc-037540f69e41. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:44.134402 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:44.150342 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-changed-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:44.150546 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Refreshing instance network info cache due to event network-changed-a139b326-ade2-4f32-bea5-e75219028adc. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:44.151009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] Acquiring lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:44.151009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] Acquired lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:44.151009 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Refreshing network info cache for port a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:44.187912 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:44.194171 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:44.324800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:44.519368 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:44.588806 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:44.639798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-941fb6cc-553e-4d14-8807-c519be45b1e1 req-943dbd57-b668-498d-a76b-586445b8f96f service nova] Releasing lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:44.653744 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:44.689712 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Took 1.45 seconds to deallocate network for instance.
May 13 04:20:44.693402 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updated VIF entry in instance network info cache for port dac0b6db-f515-440b-a43a-889f6544d3ce. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:44.693647 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updating instance_info_cache with network_info: [{"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:44.719394 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:44.804714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:44.805676 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:44.806041 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Creating image(s)
May 13 04:20:44.806835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:44.806835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:44.807269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:44.809368 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:44.812216 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:44.814093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:44.841969 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:44.914773 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:44.914773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:44.914773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:44.914773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:44.915369 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] No waiting events found dispatching network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:44.915369 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-91d2ff49-8103-4c87-9f63-dbfc659b1e47 req-2a74afb9-f3ad-4739-afdd-ac0aaf510222 service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received unexpected event network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 for instance with vm_state deleted and task_state None.
May 13 04:20:44.932180 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:44.934389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:44.935086 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:44.935896 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:44.946137 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:44.947370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:44.980708 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:44.988508 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:44.996631 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:44.996631 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:45.009817 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:45.009817 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.012813 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-037a95b7-747c-4f1e-b95c-4220403cd634 req-5d2029dd-c8c5-40b6-b4cd-33896cc6a34a service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-deleted-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:45.017378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.025029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.039628 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:45.045831 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.045831 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.045831 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.045831 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.045831 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:45.046020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.046020 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.046020 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.046020 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.046020 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:45.067089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.120s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:45.067641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:45.085402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.50.100,3260]
May 13 04:20:45.085402 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.50.100,3260] successful.
May 13 04:20:45.085402 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.087840 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.40.100,3260]
May 13 04:20:45.087840 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.40.100,3260] successful.
May 13 04:20:45.087840 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.103967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.120168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:45.124710 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk 1073741824" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:45.125113 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:45.126542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.140824 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.141639 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.141953 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:45.143031 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:45.143510 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:45.143906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:45.144723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:45.145008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:45.146009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('12', '-', '-', 0) found on session 95 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:45.146234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:45.152528 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('11', '-', '-', 0) found on session 94 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:45.152740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:45.171838 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:45.175964 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 95 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:45.176538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:45.179750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 94 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:45.179750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:45.205627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:45.207276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Releasing lock "refresh_cache-964efe52-53ac-408f-a011-b8e49c5b6fd4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:45.207276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:45.207276 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:45.207276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Acquiring lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:45.207552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:45.207641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:45.207798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] No waiting events found dispatching network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:45.207990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cfa9320-d772-4c62-90b1-9dc1d9cbd0c3 req-19fd8def-63ce-411d-b532-669c4465c2ea service nova] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Received event network-vif-unplugged-e53fdc53-1e17-4cbd-95bb-8efce5b2ae95 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:45.219804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:45.222235 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:45.222551 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:45.343546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:45.344136 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Cannot resize image /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:45.344598 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:45.346027 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Ensure instance console log exists: /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:45.346027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:45.346027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:45.346027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:45.434115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:45.434290 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:45.434522 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Attaching volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d to /dev/vdb
May 13 04:20:45.497508 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:45.511367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:20:45.540287 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:45.596016 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:20:45.597145 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:20:45.607345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:20:45.610805 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:feb1:377', 'fe80::bc99:21ff:fee9:c7a7', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962'] 
May 13 04:20:45.611014 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:20:45.611100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:20:45.611422 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:45.611701 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating existing volume attachment record: d07256ef-ef87-4bee-8680-09e8c5e24c06 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:20:45.680475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7d5a861c-dcb1-4b33-9f95-5ae0f5526451 req-985353eb-b40f-43e7-b1d4-5a05de607b94 service nova] Releasing lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:45.680905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquired lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:45.681107 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:45.876969 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:45.878770 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:45.936290 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:45.936290 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:45.954313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:20:46.121658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:46.198928 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:20:46.200341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:46.200341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:46.277246 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:46.382960 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:46.439794 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:46.476966 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:46.631573 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating instance_info_cache with network_info: [{"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:46.772351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fde99493-ba00-4ab9-9e86-599bb04b0820 req-25215689-39e4-439f-9db5-48707d2037a4 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:46.772573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde99493-ba00-4ab9-9e86-599bb04b0820 req-25215689-39e4-439f-9db5-48707d2037a4 service nova] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:46.772779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde99493-ba00-4ab9-9e86-599bb04b0820 req-25215689-39e4-439f-9db5-48707d2037a4 service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:46.772946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fde99493-ba00-4ab9-9e86-599bb04b0820 req-25215689-39e4-439f-9db5-48707d2037a4 service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:46.773086 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fde99493-ba00-4ab9-9e86-599bb04b0820 req-25215689-39e4-439f-9db5-48707d2037a4 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Processing event network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:46.773538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:46.781832 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646046.7812262, dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:46.781832 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] VM Resumed (Lifecycle Event)
May 13 04:20:46.782936 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:46.785745 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance spawned successfully.
May 13 04:20:46.786050 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:46.949696 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.743s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:46.976128 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 3300000001f434171 for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:20:46.976528 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:46.977694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.777s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:46.978180 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:20:46.979082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000001f434171', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000001f434171'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:46.979232 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001f434171', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000001f434171'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:20:46.994593 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:46.995936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:46.996452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:46.996703 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:46.997147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:46.997386 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:47.011740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:47.011740 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:47.021505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:47.021505 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:47.029669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d] added
May 13 04:20:47.029669 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:47.029669 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:47.029669 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:47.029669 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:47.029669 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:47.029669 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:47.029954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:47.030075 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:47.031184 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:47.031983 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '964efe52-53ac-408f-a011-b8e49c5b6fd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'serial': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:20:47.033874 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:20:47.034686 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:47.035200 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:20:47.036655 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Deleted allocations for instance 081ed429-cdf3-42b2-81df-a9c3b8e39a9c
May 13 04:20:47.039681 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7a461c6fc620>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '964efe52-53ac-408f-a011-b8e49c5b6fd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'serial': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:20:47.040543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d] added
May 13 04:20:47.040543 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:47.040543 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:47.040543 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:47.040543 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:47.040543 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:47.040543 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:47.040995 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97951) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 04:20:47.041185 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:47.041578 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0448(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:47.041924 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:47.042159 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] opening encrypted volume /dev/dm-6 {{(pid=97951) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 04:20:47.085951 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.luks [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 04:20:47.086138 np0000000669 nova-compute[97951]: INFO os_brick.encryptors.luks [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] /dev/dm-6 is not a valid LUKS device; formatting device for first use
May 13 04:20:47.086286 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] formatting encrypted volume /dev/dm-6 {{(pid=97951) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 04:20:47.133188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Releasing lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:47.133188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance network_info: |[{"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:47.136714 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Start _get_guest_xml network_info=[{"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:47.142797 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:47.144415 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-716242465', uuid='d071d2d8-dde9-47d3-97ea-6cee2c5b72d8'), owner=OwnerMeta(userid='434adac2000c4da29488decad2034361', username='tempest-TestEncryptedCinderVolumes-280722860-project-member', projectid='e227d582564c4ef7b5ab8d19583df520', projectname='tempest-TestEncryptedCinderVolumes-280722860'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646047.14396) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:47.145861 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:47.146180 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:47.147192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:47.147461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:47.148793 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:47.149159 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:47.149358 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:47.149489 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:47.149648 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:47.149759 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:47.149874 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:47.150073 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:47.150192 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:47.150392 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:47.150533 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:47.150704 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:47.167567 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-716242465',display_name='tempest-TestEncryptedCinderVolumes-server-716242465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-716242465',id=46,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwHBrU7GBrfDzxXRV4GSjIWVKT102okTHG/7IwWErC5mq1BlQJX06obsIt8PwaSEoEWYUaMOWrbGgz5sslJqdrJ+4Bvpe9GvILiC+SVC/ZHZtusUriyzed60IDFZjhk7Q==',key_name='tempest-keypair-2129601127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-914x6r5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=d071d2d8-dde9-47d3-97ea-6cee2c5b72d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:47.167826 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:47.168654 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:47.169957 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'pci_devices' on Instance uuid d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:47.284411 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:47.287714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:47.298679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.298679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.298679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.298679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.298679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.298964 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:47.388101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:47.675060 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <uuid>d071d2d8-dde9-47d3-97ea-6cee2c5b72d8</uuid>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <name>instance-0000002e</name>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-716242465</nova:name>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:47</nova:creationTime>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:user uuid="434adac2000c4da29488decad2034361">tempest-TestEncryptedCinderVolumes-280722860-project-member</nova:user>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:project uuid="e227d582564c4ef7b5ab8d19583df520">tempest-TestEncryptedCinderVolumes-280722860</nova:project>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         <nova:port uuid="a139b326-ade2-4f32-bea5-e75219028adc">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="serial">d071d2d8-dde9-47d3-97ea-6cee2c5b72d8</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="uuid">d071d2d8-dde9-47d3-97ea-6cee2c5b72d8</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.config"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:35:d0:2f"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <target dev="tapa139b326-ad"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/console.log" append="off"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:47.675060 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Preparing to wait for external event network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-716242465',display_name='tempest-TestEncryptedCinderVolumes-server-716242465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-716242465',id=46,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwHBrU7GBrfDzxXRV4GSjIWVKT102okTHG/7IwWErC5mq1BlQJX06obsIt8PwaSEoEWYUaMOWrbGgz5sslJqdrJ+4Bvpe9GvILiC+SVC/ZHZtusUriyzed60IDFZjhk7Q==',key_name='tempest-keypair-2129601127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-914x6r5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=d071d2d8-dde9-47d3-97ea-6cee2c5b72d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:47.678642 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:47.679441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.679736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:47.680124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:47.681336 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.681687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '028ee991-c0ae-5504-bbdd-ae37a52094d0', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:47.684452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.686086 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:47.688166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.688376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa139b326-ad, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:47.688846 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa139b326-ad, col_values=(('qos', UUID('6553405f-47f3-41f3-9d67-2ebb45b80f3a')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:47.689069 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa139b326-ad, col_values=(('external_ids', {'iface-id': 'a139b326-ade2-4f32-bea5-e75219028adc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:d0:2f', 'vm-uuid': 'd071d2d8-dde9-47d3-97ea-6cee2c5b72d8'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:47.691886 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.692978 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:47.698138 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:47.698994 np0000000669 nova-compute[97951]: INFO os_vif [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad')
May 13 04:20:47.791595 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:47.809056 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Took 12.58 seconds to spawn the instance on the hypervisor.
May 13 04:20:47.809312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:48.031688 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:48.043307 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:48.048174 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:48.048174 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.053782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-42762378-a7c4-46ce-99dc-d7aa4b182617 tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "081ed429-cdf3-42b2-81df-a9c3b8e39a9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.219s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:48.062163 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:48.062163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.065681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.080315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.090378 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.091146 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.101369 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.102317 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:48.139493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.50.100,3260]
May 13 04:20:48.139493 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.50.100,3260] successful.
May 13 04:20:48.139493 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.153711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.154872 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.40.100,3260]
May 13 04:20:48.154872 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.40.100,3260] successful.
May 13 04:20:48.154872 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.177724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.178598 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.178873 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:48.179297 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:48.179628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:48.180603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('13', '-', '-', 0) found on session 96 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:48.180820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.199566 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:48.199838 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:48.200639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:48.200924 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:48.202154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 96 and hctl ['13', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:48.202732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('14', '-', '-', 0) found on session 97 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:48.202867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:48.228871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 97 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:48.228871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:48.325969 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Took 19.52 seconds to build instance.
May 13 04:20:48.480076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:48.480259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:48.480704 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attaching volume e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 to /dev/vdb
May 13 04:20:48.538688 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:48.557742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:20:48.586772 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:48.638173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:20:48.638541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:20:48.657154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:20:48.665439 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:feb1:377', 'fe80::bc99:21ff:fee9:c7a7', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962'] 
May 13 04:20:48.665439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:20:48.665439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:20:48.665439 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:48.665439 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating existing volume attachment record: 0b3b6f5e-43fc-4754-bbca-af30a1366ff7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:20:48.831888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1cf404df-4923-4973-98fe-d80433dca261 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.051s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] No waiting events found dispatching network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:48.914831 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-80b44399-82e9-4124-8ffd-f77ef643aec3 req-d2e493b0-5ba9-463d-bc73-cdcc59d2d75f service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received unexpected event network-vif-plugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 for instance with vm_state active and task_state None.
May 13 04:20:49.206355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 96 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:49.206355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:49.253555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:49.253555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:49.253555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:35:d0:2f, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:49.253555 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Using config drive
May 13 04:20:49.264140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:20:49.264694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:49.264952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:49.722592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:49.771363 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:49.985776 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Creating config drive at /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.config
May 13 04:20:49.991080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbsqnwskp {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:50.059142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000bbc79e77 for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:20:50.059753 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.083s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:50.062353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (3860ms) {'type': 'block', 'scsi_wwn': '330000000bbc79e77', 'path': '/dev/dm-7', 'multipath_id': '330000000bbc79e77'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:50.062353 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbc79e77', 'path': '/dev/dm-7', 'multipath_id': '330000000bbc79e77'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:20:50.062353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.797s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:50.062668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:20:50.073877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbsqnwskp" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:50.074698 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:50.089456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:50.090786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:50.097584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:50.100039 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:50.100039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:50.100039 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:50.127229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:50.127229 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:50.136778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:20:50.136778 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:50.150685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2] added
May 13 04:20:50.150685 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:50.150685 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:50.150685 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:50.150685 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:50.150685 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:50.150685 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:50.151929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:50.153279 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0533(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:50.153279 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:50.154513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2] added
May 13 04:20:50.154513 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:20:50.154513 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:50.154513 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:50.154513 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:20:50.154513 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:20:50.154513 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:50.155290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:20:50.157695 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0574(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:20:50.157695 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:20:50.582800 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Attempting to attach volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:20:50.588305 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]: </disk>
May 13 04:20:50.588305 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:20:50.921383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:50.921383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:51.042194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-changed-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:51.050914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Refreshing instance network info cache due to event network-changed-e01dce11-aaaa-49cd-81e5-1f6dfb18da99. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:51.051610 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] Acquiring lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:51.052127 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] Acquired lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:51.052772 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Refreshing network info cache for port e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:51.087138 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.144702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.156537 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:51.159814 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:51.223563 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:51.223563 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.261985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:51.283039 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:51.283039 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.296230 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:51.342383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.426308 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:20:51.473574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.535929 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.536507 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:51.543934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.50.100,3260]
May 13 04:20:51.543934 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.50.100,3260] successful.
May 13 04:20:51.543934 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.556111 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:51.563006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.584501 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.585181 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.487s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:51.585181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:51.586496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('15', '-', '-', 0) found on session 98 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:51.586674 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:51.587705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.40.100,3260]
May 13 04:20:51.587705 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.40.100,3260] successful.
May 13 04:20:51.587705 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.606710 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:51.620673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 98 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:51.620673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.664718 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:51.665182 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:51.665500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.568s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:51.665500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:51.669865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('16', '-', '-', 0) found on session 99 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:51.669865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:51.704527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 99 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:51.704527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:51.802810 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.806557 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.810708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.846944 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:51.909548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a3f3e8b-8c29-4ada-bc7c-1fab710598f7 req-2cbc2773-ae0f-4e35-a0e9-3301d5987a32 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:51.909863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3f3e8b-8c29-4ada-bc7c-1fab710598f7 req-2cbc2773-ae0f-4e35-a0e9-3301d5987a32 service nova] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:51.910353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3f3e8b-8c29-4ada-bc7c-1fab710598f7 req-2cbc2773-ae0f-4e35-a0e9-3301d5987a32 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:51.910353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3f3e8b-8c29-4ada-bc7c-1fab710598f7 req-2cbc2773-ae0f-4e35-a0e9-3301d5987a32 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:51.910353 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a3f3e8b-8c29-4ada-bc7c-1fab710598f7 req-2cbc2773-ae0f-4e35-a0e9-3301d5987a32 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Processing event network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:20:52.064360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:52.064360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:52.080508 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:20:52.080508 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Claim successful on node np0000000669
May 13 04:20:52.100151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:20:52.347005 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:52.553081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:52.553500 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:52.553776 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:52.554885 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:77:ed:f4, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:52.576833 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updated VIF entry in instance network info cache for port e01dce11-aaaa-49cd-81e5-1f6dfb18da99. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:52.577070 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating instance_info_cache with network_info: [{"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:52.691769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:52.864812 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:20:52.865929 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646052.8654406, d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:52.866485 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] VM Started (Lifecycle Event)
May 13 04:20:52.871751 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:20:52.877885 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance spawned successfully.
May 13 04:20:52.878992 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:20:53.082741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f5103075-5e6d-46c5-b396-3c45daa39062 req-3b5e3b09-773f-40c7-848b-4963c9ea7239 service nova] Releasing lock "refresh_cache-dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:53.126358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found WWN 330000000f338b59d for multipath device dm-8 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:20:53.132614 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.064s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:53.132899 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== connect_volume: return (3868ms) {'type': 'block', 'scsi_wwn': '330000000f338b59d', 'path': '/dev/dm-8', 'multipath_id': '330000000f338b59d'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:53.133088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f338b59d', 'path': '/dev/dm-8', 'multipath_id': '330000000f338b59d'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:20:53.140337 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:53.372343 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:53.377918 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:53.394215 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.394215 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.395713 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.398054 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.398832 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.399059 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:20:53.647891 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attempting to attach volume e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:20:53.651640 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:   <alias name="ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2"/>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-8"/>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:   <serial>e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2</serial>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]: </disk>
May 13 04:20:53.651640 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:20:53.722950 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] opening encrypted volume /dev/dm-6 {{(pid=97951) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 04:20:53.887904 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:20:53.887904 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646053.8875966, d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:53.888135 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] VM Paused (Lifecycle Event)
May 13 04:20:53.902430 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:20:53.902430 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:20:53.910812 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Took 9.11 seconds to spawn the instance on the hypervisor.
May 13 04:20:53.912917 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:54.088755 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:54.089687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:54.090995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:54.100003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:54.100151 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] No waiting events found dispatching network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:54.100278 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-dc0ed488-b910-4b6f-9723-66de43e9644b req-9c756724-35bc-4add-8da5-49d1c2161e82 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received unexpected event network-vif-plugged-a139b326-ade2-4f32-bea5-e75219028adc for instance with vm_state active and task_state None.
May 13 04:20:54.163519 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc54ef7b-30b9-455e-81ec-7b24551e3d96 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.729s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:54.380961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:54.381215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:54.396266 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:54.403894 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646054.4034114, d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:54.403894 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] VM Resumed (Lifecycle Event)
May 13 04:20:54.406567 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:20:54.449975 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Took 20.09 seconds to build instance.
May 13 04:20:54.734555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:54.889202 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:54.925533 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:54.933136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.870s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:54.933615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:20:54.944375 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:20:54.954982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8acac053-6004-4400-ab3a-f4a5d548520e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.608s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:55.373306 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:55.373522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:55.373724 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:55.373854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No VIF found with MAC fa:16:3e:d8:74:d9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:55.449418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:20:55.449877 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:20:55.450232 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:55.450628 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:55.611222 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd175545dbc2641f88c4b0041e3d00f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a23aa4db5e48eeadf67eec77fd305c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:20:55.738543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-changed-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:55.738543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Refreshing instance network info cache due to event network-changed-a139b326-ade2-4f32-bea5-e75219028adc. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:55.738543 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] Acquiring lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:55.738543 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] Acquired lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:55.738543 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Refreshing network info cache for port a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:55.900148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:55.964714 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:20:56.127312 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Successfully created port: 4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:20:56.241489 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:56.469268 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:20:56.578700 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1206642519',display_name='tempest-TestVolumeBootPattern-server-1206642519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1206642519',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-61dndbv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:41Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=964efe52-53ac-408f-a011-b8e49c5b6fd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:56.579539 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:56.580161 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:56.582928 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 964efe52-53ac-408f-a011-b8e49c5b6fd4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:56.724171 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:56.752897 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Successfully updated port: 4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:20:56.757924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:56.757924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:56.883931 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updated VIF entry in instance network info cache for port a139b326-ade2-4f32-bea5-e75219028adc. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:56.884207 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating instance_info_cache with network_info: [{"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:56.954599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc393ef0-cf7b-40ff-a7c0-e8c984ed3a24 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.474s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:57.055537 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.055673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.055827 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Attaching volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d to /dev/vdb
May 13 04:20:57.085962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <uuid>964efe52-53ac-408f-a011-b8e49c5b6fd4</uuid>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <name>instance-0000002d</name>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-1206642519</nova:name>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:43</nova:creationTime>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         <nova:port uuid="dac0b6db-f515-440b-a43a-889f6544d3ce">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="serial">964efe52-53ac-408f-a011-b8e49c5b6fd4</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="uuid">964efe52-53ac-408f-a011-b8e49c5b6fd4</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/disk.config"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <alias name="ua-df05c3fb-3e8d-4128-ace3-ba428e14e2ee"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <serial>df05c3fb-3e8d-4128-ace3-ba428e14e2ee</serial>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:13:11:f1"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <target dev="tapdac0b6db-f5"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/console.log" append="off"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:57.085962 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Preparing to wait for external event network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1206642519',display_name='tempest-TestVolumeBootPattern-server-1206642519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1206642519',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-61dndbv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:41Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=964efe52-53ac-408f-a011-b8e49c5b6fd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:57.089454 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:57.090034 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.090151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c48b9ea-d42b-5da2-a74e-ba15b1cdd548', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:57.101674 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.102696 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:57.105317 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:57.107369 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.107652 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdac0b6db-f5, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:57.108064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdac0b6db-f5, col_values=(('qos', UUID('e4bbab67-fb3f-40c0-a456-11767b6459d1')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:57.108297 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdac0b6db-f5, col_values=(('external_ids', {'iface-id': 'dac0b6db-f515-440b-a43a-889f6544d3ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:11:f1', 'vm-uuid': '964efe52-53ac-408f-a011-b8e49c5b6fd4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:57.110045 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.111703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:57.116813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.117831 np0000000669 nova-compute[97951]: INFO os_vif [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5')
May 13 04:20:57.118513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:20:57.144092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.191953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.192208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.192473 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.192603 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.192766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:57.195179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:20:57.195366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:20:57.196150 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Terminating instance
May 13 04:20:57.203553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:20:57.204762 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:feb1:377', 'fe80::bc99:21ff:fee9:c7a7', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28'] 
May 13 04:20:57.204888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:20:57.204963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:20:57.205180 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:57.205385 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating existing volume attachment record: 6171f1f2-8e77-4c3b-8957-7936d46d3b64 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:20:57.261692 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:57.261692 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquired lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:57.261692 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:20:57.266346 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:57.387301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97d810eb-1851-4e6f-a186-d216e6106f73 req-c20174f1-7ab3-4220-8d55-a01661419460 service nova] Releasing lock "refresh_cache-d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:57.479635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:20:57.481167 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:20:57.481509 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Creating image(s)
May 13 04:20:57.482186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.482762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.483535 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:57.484995 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:57.489818 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:57.491280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.602653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:57.603794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:57.604382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:57.604948 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:57.608867 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:20:57.609264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.695984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:57.696911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.710984 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:20:57.747813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.768492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk 1073741824" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:57.769024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:57.770220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.811336 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:57.836410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:20:57.837568 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:57.839399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:57.845110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:57.845471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:20:57.869801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event network-changed-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:57.870807 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Refreshing instance network info cache due to event network-changed-4132b554-e91f-410f-b57a-a50a5aee59a8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:20:57.870807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] Acquiring lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:20:57.871399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:57.873601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:57.873813 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:20:57.875189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:20:57.877097 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:20:57.879275 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:57.898500 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:57.898500 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:20:57.905614 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:20:57.905614 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:57.908348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.138s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:57.910577 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:20:57.910804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:57.930700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:57.939397 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:20:57.965558 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.980913 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.104s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.982637 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:20:57.985676 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:20:57.986398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.113s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:57.986574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:20:57.987914 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('13', '0', '0', 0) found on session 96 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:57.988441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:57.988931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('14', '0', '0', 0) found on session 97 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:20:57.989124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:20:58.017886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 97 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:58.018076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:58.018905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 96 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:20:58.019220 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:20:58.028699 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:58.031779 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Cannot resize image /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:20:58.032251 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:20:58.034173 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Ensure instance console log exists: /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:20:58.034464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:58.034661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:58.034807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:58.064109 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:20:58.064109 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:58.064109 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:58.064814 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:58.065022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] No waiting events found dispatching network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:20:58.066184 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3216446f-25bf-4ebc-8504-0d816476ba51 req-14cfdc93-8a40-4e92-ab47-ffe5cf4dfed1 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:20:58.109093 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999670153999887 future=<Future at 0x7a463c33a360 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:58.115191 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Instance destroyed successfully.
May 13 04:20:58.115191 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lazy-loading 'resources' on Instance uuid 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:58.199930 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:58.322193 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.565s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:58.376507 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating instance_info_cache with network_info: [{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:20:58.429990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:58.430350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:58.621405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1562896071',display_name='tempest-ServersNegativeTestJSON-server-1562896071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-serversnegativetestjson-server-1562896071',id=41,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:23Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a84b573397740d5b3723cedeea8afe6',ramdisk_id='',reservation_id='r-5y1dwjui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-200158971',owner_user_name='tempest-ServersNegativeTestJSON-200158971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:23Z,user_data=None,user_id='dc9870910ccc42fe85fafc4b7facf3d0',uuid=031c6b2f-ebe7-47e8-aa7c-e5345384cec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:20:58.621405 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converting VIF {"id": "0f64a447-e138-44ea-b0f5-b984215bc61a", "address": "fa:16:3e:b1:03:77", "network": {"id": "efb9ece7-fd01-4645-9989-0557da4391b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-398215574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a84b573397740d5b3723cedeea8afe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f64a447-e1", "ovs_interfaceid": "0f64a447-e138-44ea-b0f5-b984215bc61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:58.621405 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:58.621405 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:20:58.622722 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.623252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f64a447-e1, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:58.624782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.626014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:58.632786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.633442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.633702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0326bd06-0c29-4cab-9e53-dc2e767d41ab) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:58.634243 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.634827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:58.641037 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:58.643207 np0000000669 nova-compute[97951]: INFO os_vif [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:03:77,bridge_name='br-int',has_traffic_filtering=True,id=0f64a447-e138-44ea-b0f5-b984215bc61a,network=Network(efb9ece7-fd01-4645-9989-0557da4391b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f64a447-e1')
May 13 04:20:58.643525 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Deleting instance files /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9_del
May 13 04:20:58.646437 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Deletion of /opt/stack/data/nova/instances/031c6b2f-ebe7-47e8-aa7c-e5345384cec9_del complete
May 13 04:20:58.649853 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:58.650074 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:20:58.650254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:13:11:f1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:20:58.650896 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Using config drive
May 13 04:20:58.869758 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004174020000391465 future=<Future at 0x7a4648223e30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:58.870465 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778646043.8691998, 081ed429-cdf3-42b2-81df-a9c3b8e39a9c => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:20:58.870739 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] VM Stopped (Lifecycle Event)
May 13 04:20:58.872598 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:58.872775 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.235901973999717 future=<Future at 0x7a463c33a360 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:58.872894 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.235814310000023 future=<Future at 0x7a463c33a360 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:20:58.878600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:20:58.879062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Releasing lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:20:58.879347 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Instance network_info: |[{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:20:58.879993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] Acquired lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:20:58.880250 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Refreshing network info cache for port 4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:20:58.883426 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Start _get_guest_xml network_info=[{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:20:58.890811 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:20:58.892635 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-150189682', uuid='6a3bb372-804d-4ddd-a8fa-03591cf3f5c0'), owner=OwnerMeta(userid='d175545dbc2641f88c4b0041e3d00f21', username='tempest-VolumesExtendAttachedTest-518230319-project-member', projectid='65a23aa4db5e48eeadf67eec77fd305c', projectname='tempest-VolumesExtendAttachedTest-518230319'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646058.892239) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:20:58.894382 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:20:58.894607 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:20:58.895792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:20:58.895968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:20:58.896907 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:20:58.897206 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:20:58.897376 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:20:58.897475 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:20:58.897609 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:20:58.897724 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:20:58.897818 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:20:58.897990 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:20:58.898087 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:20:58.898194 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:20:58.898303 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:20:58.898475 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:20:58.910663 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-150189682',display_name='tempest-VolumesExtendAttachedTest-instance-150189682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesextendattachedtest-instance-150189682',id=47,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbKoUQmqoxcbDNBgWG6YRLoPOxFoLgRSDIXFMqCZH56zgXduiaWW3aGqdai+o4Zsezxx5Ad+6y2JqmLzteTBaKe1y9I6V0AGX9zpKJF7yHcP58MJK0VpqhdIuH28ujOQ==',key_name='tempest-keypair-137503066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65a23aa4db5e48eeadf67eec77fd305c',ramdisk_id='',reservation_id='r-x1wh7s9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-518230319',owner_user_name='tempest-VolumesExtendAttachedTest-518230319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d175545dbc2641f88c4b0041e3d00f21',uuid=6a3bb372-804d-4ddd-a8fa-03591cf3f5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:20:58.911632 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converting VIF {"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:58.911632 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:58.912148 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:58.933991 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:59.151869 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 04:20:59.152425 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:20:59.152675 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:20:59.152779 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:20:59.152971 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:59.158071 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:59.321976 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:59.338083 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:59.338528 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:59.339189 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Attaching volume 8fda3549-abd1-4948-9eaa-09a28927de94 to /dev/vdb
May 13 04:20:59.351704 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Creating config drive at /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/disk.config
May 13 04:20:59.357898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpus85zsvy {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:59.390714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4c20f361-b707-48d4-a5cb-5899f36dbb6e tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 081ed429-cdf3-42b2-81df-a9c3b8e39a9c] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:20:59.391573 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:59.416820 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] End _get_guest_xml xml=<domain type="qemu">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <uuid>6a3bb372-804d-4ddd-a8fa-03591cf3f5c0</uuid>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <name>instance-0000002f</name>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-150189682</nova:name>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:20:58</nova:creationTime>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:user uuid="d175545dbc2641f88c4b0041e3d00f21">tempest-VolumesExtendAttachedTest-518230319-project-member</nova:user>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:project uuid="65a23aa4db5e48eeadf67eec77fd305c">tempest-VolumesExtendAttachedTest-518230319</nova:project>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         <nova:port uuid="4132b554-e91f-410f-b57a-a50a5aee59a8">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <system>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="serial">6a3bb372-804d-4ddd-a8fa-03591cf3f5c0</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="uuid">6a3bb372-804d-4ddd-a8fa-03591cf3f5c0</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </system>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <os>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </os>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <features>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </features>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   <devices>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.config"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </disk>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d2:6c:4a"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <target dev="tap4132b554-e9"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </interface>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/console.log" append="off"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </serial>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <video>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </video>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </rng>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:   </devices>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]: </domain>
May 13 04:20:59.416820 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:20:59.423743 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Preparing to wait for external event network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:20:59.423743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:20:59.423743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:20:59.423743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:59.423943 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:20:59.424484 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-150189682',display_name='tempest-VolumesExtendAttachedTest-instance-150189682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesextendattachedtest-instance-150189682',id=47,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbKoUQmqoxcbDNBgWG6YRLoPOxFoLgRSDIXFMqCZH56zgXduiaWW3aGqdai+o4Zsezxx5Ad+6y2JqmLzteTBaKe1y9I6V0AGX9zpKJF7yHcP58MJK0VpqhdIuH28ujOQ==',key_name='tempest-keypair-137503066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65a23aa4db5e48eeadf67eec77fd305c',ramdisk_id='',reservation_id='r-x1wh7s9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-518230319',owner_user_name='tempest-VolumesExtendAttachedTest-518230319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d175545dbc2641f88c4b0041e3d00f21',uuid=6a3bb372-804d-4ddd-a8fa-03591cf3f5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:20:59.424762 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converting VIF {"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:20:59.425839 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:20:59.426164 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:20:59.427045 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.427399 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:59.427966 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:20:59.434833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.434833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad3d8433-61c3-53e2-a7bf-9e465ae95ed6', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:59.435427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpus85zsvy" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:20:59.444688 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:59.451742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:20:59.456134 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.456134 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4132b554-e9, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:59.456134 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4132b554-e9, col_values=(('qos', UUID('f020926c-b851-4047-8c54-19f94be08255')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:59.456134 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4132b554-e9, col_values=(('external_ids', {'iface-id': '4132b554-e91f-410f-b57a-a50a5aee59a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:6c:4a', 'vm-uuid': '6a3bb372-804d-4ddd-a8fa-03591cf3f5c0'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:20:59.456729 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.458063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:20:59.471353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.471353 np0000000669 nova-compute[97951]: INFO os_vif [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9')
May 13 04:20:59.485783 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:20:59.537556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:20:59.538473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:20:59.548179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:20:59.550448 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28'] 
May 13 04:20:59.551230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:20:59.551553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:20:59.551928 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:59.552451 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating existing volume attachment record: dce2b851-2be3-492f-be4c-eef790da9f1a {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:20:59.732759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.797454 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:20:59.895929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000bbc79e77 for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:20:59.896582 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.054s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:20:59.896839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (2059ms) {'type': 'block', 'scsi_wwn': '330000000bbc79e77', 'path': '/dev/dm-7', 'multipath_id': '330000000bbc79e77'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:20:59.897048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbc79e77', 'path': '/dev/dm-7', 'multipath_id': '330000000bbc79e77'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:20:59.907288 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.910534 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:20:59.945957 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:20:59.948515 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.949979 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:20:59.972047 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updated VIF entry in instance network info cache for port 4132b554-e91f-410f-b57a-a50a5aee59a8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:20:59.972502 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating instance_info_cache with network_info: [{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:00.043401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.124268 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:00.126267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:00.126267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:00.126267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:00.126267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:00.139565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:00.141186 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:00.141439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:00.141664 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:00.142027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:00.142187 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:00.144190 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:00.148235 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-09dfe406-4b67-4172-9060-10d3695968db req-8f9dc154-e0e5-428f-b04d-f0f045ca34b3 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:00.148664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09dfe406-4b67-4172-9060-10d3695968db req-8f9dc154-e0e5-428f-b04d-f0f045ca34b3 service nova] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:00.148664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09dfe406-4b67-4172-9060-10d3695968db req-8f9dc154-e0e5-428f-b04d-f0f045ca34b3 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:00.149853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09dfe406-4b67-4172-9060-10d3695968db req-8f9dc154-e0e5-428f-b04d-f0f045ca34b3 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:00.151679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-09dfe406-4b67-4172-9060-10d3695968db req-8f9dc154-e0e5-428f-b04d-f0f045ca34b3 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Processing event network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:00.160181 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:00.160181 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:00.168194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:00.168194 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:00.171997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:00.172637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] Acquiring lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:00.172905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] No waiting events found dispatching network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-unplugged-0f64a447-e138-44ea-b0f5-b984215bc61a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Received event network-vif-deleted-0f64a447-e138-44ea-b0f5-b984215bc61a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Neutron deleted interface 0f64a447-e138-44ea-b0f5-b984215bc61a; detaching it from the instance and deleting it from the info cache
May 13 04:21:00.174919 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:00.177971 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94] added
May 13 04:21:00.177971 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:00.177971 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:00.177971 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:00.177971 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:00.177971 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:00.177971 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:00.178843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:00.179311 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:00.180064 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:00.185781 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94] added
May 13 04:21:00.185781 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:00.185781 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:00.185781 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:00.185781 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:00.185781 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:00.185781 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:00.186101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:00.186256 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.044(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:00.186440 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:00.276516 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.283815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.287798 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.317508 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.323805 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:00.413814 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Attempting to attach volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:00.416028 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:00.416028 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:00.474596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-96377b39-e81a-4951-8ac1-a647a970b33a req-dee6d727-ee6b-41aa-8c95-beb43d98e02b service nova] Releasing lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:00.646370 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Took 1.49 seconds to deallocate network for instance.
May 13 04:21:00.682725 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3a8df184-0520-4d58-86ff-578c4e6004fb req-ba24200b-5e38-4970-97ea-b3f4f0d9c008 service nova] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Detach interface failed, port_id=0f64a447-e138-44ea-b0f5-b984215bc61a, reason: Instance 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:21:00.882030 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:00.882473 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646060.882183, 964efe52-53ac-408f-a011-b8e49c5b6fd4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:00.882633 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] VM Started (Lifecycle Event)
May 13 04:21:00.886350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:00.889194 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Instance spawned successfully.
May 13 04:21:00.889537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:00.995785 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:00.996274 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:00.996274 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No VIF found with MAC fa:16:3e:d2:6c:4a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:00.996591 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Using config drive
May 13 04:21:01.028400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:01.028605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:01.028850 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attaching volume 595c3361-04e6-40f7-a9bb-26ac48af4355 to /dev/vdc
May 13 04:21:01.078227 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:01.090397 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:01.115727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:01.158408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:01.158408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:01.168873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:01.169129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:01.178786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:01.180240 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe3e:7976', 'fe80::b4ff:dbff:fee0:96cd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe13:11f1', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:21:01.180424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:01.180565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:01.180845 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:01.181074 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating existing volume attachment record: bf4c9fe2-8700-4463-8304-8f6949c528ef {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:01.183462 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:01.186877 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:01.198529 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:01.198529 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:01.207896 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:01.207896 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.216768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.223461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.236494 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.237005 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.242760 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.242975 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:01.288791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.40.100,3260]
May 13 04:21:01.288791 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.40.100,3260] successful.
May 13 04:21:01.288791 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.303090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.311870 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.50.100,3260]
May 13 04:21:01.311870 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.50.100,3260] successful.
May 13 04:21:01.311870 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.326345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.328741 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.329165 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:01.331083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:01.331083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:01.332167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('17', '-', '-', 0) found on session 100 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:01.332167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:01.350562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 100 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:01.350562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:01.352379 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:01.352379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:01.354148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] HCTL ('18', '-', '-', 0) found on session 101 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:01.354148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:01.373288 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 101 and hctl ['18', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:01.385672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:01.396047 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:01.403053 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.404272 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.404687 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.404972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.405344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.405611 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:01.506669 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:01.711054 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Creating config drive at /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.config
May 13 04:21:01.719417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplyawlxfg {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:01.764025 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:01.764862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:01.765067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:01.779223 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplyawlxfg" returned: 0 in 0.060s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:01.842054 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:01.842315 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:01.899776 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:01.900136 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646061.8999414, 964efe52-53ac-408f-a011-b8e49c5b6fd4 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:01.900282 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] VM Paused (Lifecycle Event)
May 13 04:21:01.911406 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Took 18.02 seconds to spawn the instance on the hypervisor.
May 13 04:21:01.911533 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:02.105143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:02.105701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:02.105701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:02.105701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:e3:02:55, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:02.222187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.226156 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:02.227042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:02.227042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:02.227183 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:02.227224 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] No waiting events found dispatching network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:02.227491 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-5691ddda-5b64-4f34-8169-398e53146cdb req-3ca377b1-0d00-4540-8407-4603a76d5147 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received unexpected event network-vif-plugged-dac0b6db-f515-440b-a43a-889f6544d3ce for instance with vm_state active and task_state None.
May 13 04:21:02.255509 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.349254 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:02.358064 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.375971 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Searching for a device in session 101 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:02.376125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:02.402855 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:02.407723 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646062.4074056, 964efe52-53ac-408f-a011-b8e49c5b6fd4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:02.407859 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] VM Resumed (Lifecycle Event)
May 13 04:21:02.429136 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Took 31.66 seconds to build instance.
May 13 04:21:02.576186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.578560 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.605571 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:02.862459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.703s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:02.910889 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:02.915232 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:02.924018 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Deleted allocations for instance 031c6b2f-ebe7-47e8-aa7c-e5345384cec9
May 13 04:21:02.931598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.170s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:03.156797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found WWN 3300000002336141b for multipath device dm-10 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:03.157187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:03.157452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000002336141b', 'path': '/dev/dm-10', 'multipath_id': '3300000002336141b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:03.157509 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002336141b', 'path': '/dev/dm-10', 'multipath_id': '3300000002336141b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:03.157960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.393s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:03.158294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:03.170408 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:03.176026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:03.176686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:03.177142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:03.177550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:03.177893 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:03.178142 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:03.189759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:03.189759 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:03.195533 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:03.195533 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355] added
May 13 04:21:03.207352 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:03.207352 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:03.207352 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:03.211628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355] added
May 13 04:21:03.211628 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:03.211628 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:03.211628 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:03.211628 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:03.211628 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:03.211628 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:03.211941 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:03.211941 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:03.212032 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:03.418096 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646063.4177375, 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:03.418257 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] VM Started (Lifecycle Event)
May 13 04:21:03.667534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b3ed0b8d-1301-47b5-b15e-96ed4cb9f2b3 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.612s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:03.672995 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Attempting to attach volume 8fda3549-abd1-4948-9eaa-09a28927de94 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:03.676970 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:   <alias name="ua-8fda3549-abd1-4948-9eaa-09a28927de94"/>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:   <serial>8fda3549-abd1-4948-9eaa-09a28927de94</serial>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:03.676970 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:03.826028 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:03.826227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:03.826425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:03.826575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:03.826748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:03.828860 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Terminating instance
May 13 04:21:03.920709 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:03.922758 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646063.9224923, 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:03.923008 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] VM Paused (Lifecycle Event)
May 13 04:21:03.933378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85b9ab19-35b9-4537-aba5-e5fc44076a6d tempest-ServersNegativeTestJSON-200158971 tempest-ServersNegativeTestJSON-200158971-project-member] Lock "031c6b2f-ebe7-47e8-aa7c-e5345384cec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.741s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:04.056083 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:04.056442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:04.205034 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:04.212412 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:04.219427 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:04.219427 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:04.228463 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:04.228463 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.236797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.247746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.260935 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.261611 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.268572 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.269107 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:04.299462 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:04.299670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:04.300371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:04.300371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:04.300371 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Processing event network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:04.300706 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:04.300706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:04.300802 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:04.300956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:04.301169 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] No waiting events found dispatching network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:04.301317 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-8464380f-76ed-4a84-801b-c44987285cd5 req-22dcb9f5-4ade-4eb2-a15c-2d09cbbd6d67 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received unexpected event network-vif-plugged-4132b554-e91f-410f-b57a-a50a5aee59a8 for instance with vm_state building and task_state spawning.
May 13 04:21:04.302707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:04.309562 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:04.315107 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Instance spawned successfully.
May 13 04:21:04.315637 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:04.322099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.40.100,3260]
May 13 04:21:04.322099 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.40.100,3260] successful.
May 13 04:21:04.322099 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.335354 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:21:04.335354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.50.100,3260]
May 13 04:21:04.335354 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.50.100,3260] successful.
May 13 04:21:04.335354 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.344744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.354584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:04.362671 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.367102 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.378579 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:04.381640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:04.381640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:04.383806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('19', '-', '-', 0) found on session 102 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:04.383806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.384808 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:04.386463 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:04.386463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:04.389049 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] HCTL ('20', '-', '-', 0) found on session 103 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:04.389049 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:04.403081 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.403081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 102 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:04.403081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:04.414666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Searching for a device in session 103 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:04.414867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:04.425439 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:04.434302 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646064.4339478, 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:04.434531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] VM Resumed (Lifecycle Event)
May 13 04:21:04.436110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.456667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.559032 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Detaching volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:21:04.640850 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Attempting to driver detach volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d from mountpoint /dev/vdb
May 13 04:21:04.645044 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:04.646852 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:04.646852 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Attempting to detach device vdb from instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:04.646852 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:04.646852 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:04.656551 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 from the persistent domain config.
May 13 04:21:04.657079 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] (1/8): Attempting to detach device vdb with device alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d from instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:04.657509 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:04.657509 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:04.668955 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.677790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.705856 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Instance destroyed successfully.
May 13 04:21:04.706255 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 964efe52-53ac-408f-a011-b8e49c5b6fd4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:04.736072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:04.828494 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.828688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.829104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.829441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.829820 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.830135 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:04.943157 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:04.951213 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:05.178002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:21:05.209285 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1206642519',display_name='tempest-TestVolumeBootPattern-server-1206642519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1206642519',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:01Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-61dndbv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:21:02Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=964efe52-53ac-408f-a011-b8e49c5b6fd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:21:05.209882 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "dac0b6db-f515-440b-a43a-889f6544d3ce", "address": "fa:16:3e:13:11:f1", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac0b6db-f5", "ovs_interfaceid": "dac0b6db-f515-440b-a43a-889f6544d3ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:05.210154 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:05.210886 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:21:05.212251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.212495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdac0b6db-f5, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:05.213659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.215074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:05.215074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.215778 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.215915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4bbab67-fb3f-40c0-a456-11767b6459d1) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:05.216428 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.217116 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:05.218175 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.220003 np0000000669 nova-compute[97951]: INFO os_vif [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:11:f1,bridge_name='br-int',has_traffic_filtering=True,id=dac0b6db-f515-440b-a43a-889f6544d3ce,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac0b6db-f5')
May 13 04:21:05.260489 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '964efe52-53ac-408f-a011-b8e49c5b6fd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'serial': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:21:05.261069 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:21:05.261350 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:05.261533 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:05.262131 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7a461c619490>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '964efe52-53ac-408f-a011-b8e49c5b6fd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'serial': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:21:05.262271 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] closing encrypted volume /dev/dm-9 {{(pid=97951) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 13 04:21:05.294354 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:05.294354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:05.294354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:05.330481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:05.332246 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:05.332246 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:05.332246 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] No VIF found with MAC fa:16:3e:3e:79:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:05.336030 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Took 7.86 seconds to spawn the instance on the hypervisor.
May 13 04:21:05.336370 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:05.383967 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d for instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:05.453911 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:05.454288 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999840843000129 future=<Future at 0x7a463c0c0c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:05.454508 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646065.454317, e6cd15e9-77cc-41e7-81f9-839b352be4a5 => ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:05.463426 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 from the live domain config.
May 13 04:21:05.825118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:05.848440 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Took 13.91 seconds to build instance.
May 13 04:21:06.015682 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Detected multiple connections on this host for volume: 9389f36f-c351-4bc4-8d31-7fedcc0de73d, skipping target disconnect.
May 13 04:21:06.200209 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found WWN 330000000f218f03b for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:06.200570 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:06.201094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== connect_volume: return (4436ms) {'type': 'block', 'scsi_wwn': '330000000f218f03b', 'path': '/dev/dm-11', 'multipath_id': '330000000f218f03b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:06.201094 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f218f03b', 'path': '/dev/dm-11', 'multipath_id': '330000000f218f03b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:06.201713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.907s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:06.202171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:06.202815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:06.205172 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:06.245063 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:06.245974 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:06.245974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '99')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:06.246504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', '94')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:06.247660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee', '95')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:06.249711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482c2200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:06.250307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:06.250659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 3300000001f434171 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:06.286748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:06.332969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:06.351681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ace3c00d-f1ff-49a5-9d4c-120fd693b4be tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.431s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:06.373824 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:06.374057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:06.374281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:06.374540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:06.374724 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] No waiting events found dispatching network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:06.374858 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:06.375040 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:06.375211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Acquiring lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:06.377477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:06.377534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:06.377714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] No waiting events found dispatching network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:06.377879 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf51d8d0-d514-4b7d-9867-762d10de4d7e req-566a4d45-9e2c-4974-8200-58356cb77723 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-unplugged-dac0b6db-f515-440b-a43a-889f6544d3ce for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:06.378705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:06.378858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:06.380826 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:06.394097 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:06.394293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:06.408100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.449156 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.40.100,3260]
May 13 04:21:06.449156 np0000000669 nova-compute[97951]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.40.100,3260] successful.
May 13 04:21:06.449156 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.476973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.491567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.530764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.50.100,3260]
May 13 04:21:06.530764 np0000000669 nova-compute[97951]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-df05c3fb-3e8d-4128-ace3-ba428e14e2ee, portal: 192.168.50.100,3260] successful.
May 13 04:21:06.530764 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.562435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:06.562813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:06.562968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (1268ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:06.563162 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:06.564932 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Deleting instance files /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4_del
May 13 04:21:06.564932 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Deletion of /opt/stack/data/nova/instances/964efe52-53ac-408f-a011-b8e49c5b6fd4_del complete
May 13 04:21:06.570516 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:06.709103 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attempting to attach volume 595c3361-04e6-40f7-a9bb-26ac48af4355 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:06.710969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:   <alias name="ua-595c3361-04e6-40f7-a9bb-26ac48af4355"/>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:   <serial>595c3361-04e6-40f7-a9bb-26ac48af4355</serial>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:06.710969 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:06.904177 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fda6f429-a7ae-4691-8bda-d59c8f0a8289 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.565s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:07.082105 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Took 2.75 seconds to destroy the instance on the hypervisor.
May 13 04:21:07.082940 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:21:07.085092 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:21:07.085195 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:21:07.085818 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:07.250607 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:07.470835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:07.470999 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:07.549832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:07.550549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:07.584915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-377a11fd-5366-4771-81e0-b5dae307196a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.528s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:07.670441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b452bc9f-acbc-434b-a8d2-960329e42588 req-3dd87059-c432-49a5-aba2-c0c18ea225b8 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Received event network-vif-deleted-dac0b6db-f515-440b-a43a-889f6544d3ce {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:07.671037 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-b452bc9f-acbc-434b-a8d2-960329e42588 req-3dd87059-c432-49a5-aba2-c0c18ea225b8 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Neutron deleted interface dac0b6db-f515-440b-a43a-889f6544d3ce; detaching it from the instance and deleting it from the info cache
May 13 04:21:07.671219 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b452bc9f-acbc-434b-a8d2-960329e42588 req-3dd87059-c432-49a5-aba2-c0c18ea225b8 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:07.880470 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event network-changed-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:07.880628 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Refreshing instance network info cache due to event network-changed-4132b554-e91f-410f-b57a-a50a5aee59a8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:07.881081 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] Acquiring lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:07.881486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] Acquired lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:07.881630 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Refreshing network info cache for port 4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:07.974694 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Detaching volume 8fda3549-abd1-4948-9eaa-09a28927de94
May 13 04:21:08.037607 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Attempting to driver detach volume 8fda3549-abd1-4948-9eaa-09a28927de94 from mountpoint /dev/vdb
May 13 04:21:08.046288 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-8fda3549-abd1-4948-9eaa-09a28927de94 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:08.048509 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Found disk vdb by alias ua-8fda3549-abd1-4948-9eaa-09a28927de94 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:08.048640 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Attempting to detach device vdb from instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:08.048897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <alias name="ua-8fda3549-abd1-4948-9eaa-09a28927de94"/>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <serial>8fda3549-abd1-4948-9eaa-09a28927de94</serial>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:08.048897 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:08.054597 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 from the persistent domain config.
May 13 04:21:08.054869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] (1/8): Attempting to detach device vdb with device alias ua-8fda3549-abd1-4948-9eaa-09a28927de94 from instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:08.055244 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <alias name="ua-8fda3549-abd1-4948-9eaa-09a28927de94"/>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-10"/>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <serial>8fda3549-abd1-4948-9eaa-09a28927de94</serial>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:08.055244 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:08.057379 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Detaching volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d
May 13 04:21:08.071421 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:08.116708 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Attempting to driver detach volume 9389f36f-c351-4bc4-8d31-7fedcc0de73d from mountpoint /dev/vdb
May 13 04:21:08.124645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:08.126516 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:08.126661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Attempting to detach device vdb from instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:08.127286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:08.127286 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:08.143765 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 from the persistent domain config.
May 13 04:21:08.144694 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] (1/8): Attempting to detach device vdb with device alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d from instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:08.144694 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <alias name="ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d"/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <serial>9389f36f-c351-4bc4-8d31-7fedcc0de73d</serial>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:08.144694 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:08.179106 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b452bc9f-acbc-434b-a8d2-960329e42588 req-3dd87059-c432-49a5-aba2-c0c18ea225b8 service nova] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Detach interface failed, port_id=dac0b6db-f515-440b-a43a-889f6544d3ce, reason: Instance 964efe52-53ac-408f-a011-b8e49c5b6fd4 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:21:08.384025 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:08.426962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:08.427103 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:08.427252 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:08.427405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:08.427536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] No VIF found with MAC fa:16:3e:d8:74:d9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:08.581406 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Took 1.50 seconds to deallocate network for instance.
May 13 04:21:08.653141 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646068.6525743, 4b2f0d86-83ca-4a76-8950-cd2768dedf23 => ua-8fda3549-abd1-4948-9eaa-09a28927de94> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:08.657155 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8fda3549-abd1-4948-9eaa-09a28927de94 for instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:08.663788 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully detached device vdb from instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 from the live domain config.
May 13 04:21:08.666603 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:08.666947 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:08.667101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:08.667521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:08.667892 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fda3549-abd1-4948-9eaa-09a28927de94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:08.668048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:08.708334 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:08.708739 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:08.709093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '99')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:08.709093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '100')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:08.710179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94', '101')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:08.711234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c115b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'): ({'sdm'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:08.713562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Removing multipathed devices sdm, sdl {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:08.714337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Flush multipath device 3300000002336141b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:08.746082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:08.804577 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:08.807871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:08.861301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:08.861538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:08.863717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:08.879994 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:08.880246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:08.892601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:08.933948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.40.100,3260]
May 13 04:21:08.933948 np0000000669 nova-compute[97951]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.40.100,3260] successful.
May 13 04:21:08.933948 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:08.960189 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updated VIF entry in instance network info cache for port 4132b554-e91f-410f-b57a-a50a5aee59a8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:08.960189 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating instance_info_cache with network_info: [{"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:08.962068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:08.976509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:09.018579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.50.100,3260]
May 13 04:21:09.018579 np0000000669 nova-compute[97951]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-8fda3549-abd1-4948-9eaa-09a28927de94, portal: 192.168.50.100,3260] successful.
May 13 04:21:09.018579 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:09.037495 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:09.037697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:09.037784 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] <== disconnect_volume: return (371ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:09.037892 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:09.152711 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Took 0.57 seconds to detach 1 volumes for instance.
May 13 04:21:09.462302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7249ed6f-db5f-4508-a9bf-2ff061917e5b req-ddabacd7-eafd-459b-a6ac-ac69b88257d2 service nova] Releasing lock "refresh_cache-6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:09.600384 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'flavor' on Instance uuid 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:09.659164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:09.659809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:09.740040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:09.995417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b7212ce5-26ff-4069-a0b9-5f897d793e6a tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.967s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:10.157155 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:10.157517 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:10.217305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:10.615216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f79fde2-b10e-4568-b50d-e79004db31ef tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.144s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:10.661316 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:10.783424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:10.783908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:10.783908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:10.784053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:10.784212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:10.787009 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Terminating instance
May 13 04:21:11.173082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.513s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:11.237494 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 964efe52-53ac-408f-a011-b8e49c5b6fd4
May 13 04:21:11.291296 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:21:11.319219 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:11.324521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:11.354079 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:11.392521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:11.486359 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646071.4853053, bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 => ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:11.487958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9389f36f-c351-4bc4-8d31-7fedcc0de73d for instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:11.495354 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 from the live domain config.
May 13 04:21:11.541849 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:11.542090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:11.542199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:11.542546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:11.542847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9389f36f-c351-4bc4-8d31-7fedcc0de73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:11.542977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:11.547314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:11.548457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:11.549618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:11.549618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:11.549618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] No waiting events found dispatching network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:11.549618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fd2c6fac-a838-4a3d-b5f5-b8899d42c415 req-b946cab2-37f1-4576-8fde-5b660dd0925f service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:11.582549 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:11.582921 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:11.583210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '99')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:11.583210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '97')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:11.584685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d', '96')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:11.589654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46481f2d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'): ({'sdh'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:11.589996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:11.591360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flush multipath device 330000000bbc79e77 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:11.631163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:11.662955 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999643113000275 future=<Future at 0x7a463c0fe540 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:11.663991 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Instance destroyed successfully.
May 13 04:21:11.665239 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lazy-loading 'resources' on Instance uuid 4b2f0d86-83ca-4a76-8950-cd2768dedf23 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:11.689463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:11.732935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:11.733130 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:11.734986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:11.750004 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:11.750415 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:11.771922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.820177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.40.100,3260]
May 13 04:21:11.820177 np0000000669 nova-compute[97951]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.40.100,3260] successful.
May 13 04:21:11.820177 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.854227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.869234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.914808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.50.100,3260]
May 13 04:21:11.914808 np0000000669 nova-compute[97951]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-9389f36f-c351-4bc4-8d31-7fedcc0de73d, portal: 192.168.50.100,3260] successful.
May 13 04:21:11.914808 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.936438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:11.936802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:11.936929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== disconnect_volume: return (394ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:11.937047 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:12.170038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1927455728',display_name='tempest-AttachVolumeNegativeTest-server-1927455728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumenegativetest-server-1927455728',id=39,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI1IcY1rNTnPNxSVNpHWp/2L1YwrtNWf/ekbIs9uAWvvqqsNVtA4+6MbZ8KqJ0tGWhKO9k0OkkkuhBFtaDGhSJwa4Es4UK5T1xlap0yPY6gmzHPk1+3RFpPtKsDscx06g==',key_name='tempest-keypair-594056268',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:16Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c06d9163829483dafb7a6dcd1a3f194',ramdisk_id='',reservation_id='r-4ok1q74t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1451451802',owner_user_name='tempest-AttachVolumeNegativeTest-1451451802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b11065076cd40ffaa5099174eda4db9',uuid=4b2f0d86-83ca-4a76-8950-cd2768dedf23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:21:12.170319 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converting VIF {"id": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "address": "fa:16:3e:3e:79:76", "network": {"id": "8e75ebb4-9ad0-4b1d-aa01-45793314acbd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-924907766-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c06d9163829483dafb7a6dcd1a3f194", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a2ef47-e4", "ovs_interfaceid": "48a2ef47-e423-4089-94cb-2fbecdbcab81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:12.171023 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:12.171288 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:21:12.172424 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.173110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48a2ef47-e4, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:12.174021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.175680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.176915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.177225 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d030d8c2-5b9b-4a12-8a44-096b128904b3) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:12.177842 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.178782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:12.178920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:12.181617 np0000000669 nova-compute[97951]: INFO os_vif [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:79:76,bridge_name='br-int',has_traffic_filtering=True,id=48a2ef47-e423-4089-94cb-2fbecdbcab81,network=Network(8e75ebb4-9ad0-4b1d-aa01-45793314acbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a2ef47-e4')
May 13 04:21:12.181908 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Deleting instance files /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23_del
May 13 04:21:12.182689 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Deletion of /opt/stack/data/nova/instances/4b2f0d86-83ca-4a76-8950-cd2768dedf23_del complete
May 13 04:21:12.254119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c741d178-4a7f-483e-af5a-1c11a1245325 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "964efe52-53ac-408f-a011-b8e49c5b6fd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.428s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:12.508976 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:12.688903 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:21:12.690022 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:21:12.690022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:21:12.690022 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:21:12.690022 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:12.782269 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:13.109250 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00046417400017162436 future=<Future at 0x7a463c33a360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:13.109813 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:13.109813 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.344410956000047 future=<Future at 0x7a463c0c0c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:13.109813 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.344276785000147 future=<Future at 0x7a463c0c0c80 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:13.110289 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646058.108599, 031c6b2f-ebe7-47e8-aa7c-e5345384cec9 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:13.112043 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] VM Stopped (Lifecycle Event)
May 13 04:21:13.517592 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bd697e72-d341-485f-89ba-577fdddbb693 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.968s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:13.616948 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b1de5a63-800b-4a11-aabe-0f865d42120a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 031c6b2f-ebe7-47e8-aa7c-e5345384cec9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:13.634309 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:13.634459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] Acquiring lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:13.635208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:13.635428 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:13.635603 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] No waiting events found dispatching network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:13.636188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-unplugged-48a2ef47-e423-4089-94cb-2fbecdbcab81 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:13.639090 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Received event network-vif-deleted-48a2ef47-e423-4089-94cb-2fbecdbcab81 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:13.639601 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Neutron deleted interface 48a2ef47-e423-4089-94cb-2fbecdbcab81; detaching it from the instance and deleting it from the info cache
May 13 04:21:13.639793 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:13.853793 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:14.149183 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba60e794-3627-4e59-a563-db32195aa05e req-801c79a9-b444-4d55-8874-aa77d7a6a3c6 service nova] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Detach interface failed, port_id=48a2ef47-e423-4089-94cb-2fbecdbcab81, reason: Instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:21:14.356970 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Took 1.67 seconds to deallocate network for instance.
May 13 04:21:14.739298 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:14.869100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:14.869573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:15.103858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:15.104017 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:15.415942 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:15.416146 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:15.606232 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:21:15.922698 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:16.170070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:16.428146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.558s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:16.429100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.259s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:16.432425 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:21:16.432903 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Claim successful on node np0000000669
May 13 04:21:16.482998 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Deleted allocations for instance 4b2f0d86-83ca-4a76-8950-cd2768dedf23
May 13 04:21:16.791763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:16.791763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:17.178899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:17.293469 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Detaching volume e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2
May 13 04:21:17.356376 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attempting to driver detach volume e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 from mountpoint /dev/vdb
May 13 04:21:17.367808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found disk vdb by alias ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:17.369243 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found disk vdb by alias ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:17.369425 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Attempting to detach device vdb from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:17.369817 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <alias name="ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2"/>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-8"/>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <serial>e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2</serial>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:17.369817 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:17.376419 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully detached device vdb from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the persistent domain config.
May 13 04:21:17.376568 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] (1/8): Attempting to detach device vdb with device alias ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:17.376871 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <alias name="ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2"/>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-8"/>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <serial>e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2</serial>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:17.376871 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:17.491248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3ce04659-4625-43af-be81-03daa79974d4 tempest-AttachVolumeNegativeTest-1451451802 tempest-AttachVolumeNegativeTest-1451451802-project-member] Lock "4b2f0d86-83ca-4a76-8950-cd2768dedf23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.707s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:17.951497 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:17.951695 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:17.966068 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646077.9657218, fd379e34-a21d-45c7-99e6-6f77272bc1ce => ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:17.967013 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 for instance fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:17.973212 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully detached device vdb from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the live domain config.
May 13 04:21:17.975076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:17.975133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:17.975236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:17.976196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:17.976499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:17.976679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:18.014916 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2 (non-flash)
May 13 04:21:18.015134 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:18.015134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '99')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:18.015509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '99')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:18.016188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2', '98')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:18.017454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c6514e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:18.017454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:18.017615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Flush multipath device 330000000f338b59d {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:18.048067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:18.093466 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:18.149208 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:18.149657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:18.151254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:18.163001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:18.163754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:18.175478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.182562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:18.182965 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:18.215070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.40.100,3260]
May 13 04:21:18.215070 np0000000669 nova-compute[97951]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.40.100,3260] successful.
May 13 04:21:18.215070 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.236118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.249654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.285536 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.50.100,3260]
May 13 04:21:18.285536 np0000000669 nova-compute[97951]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-e9985aa0-be0a-4a9a-b7e8-84d8a76dacf2, portal: 192.168.50.100,3260] successful.
May 13 04:21:18.285536 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.305668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:18.305903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:18.306035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== disconnect_volume: return (330ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:18.306163 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:18.454292 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:18.684986 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:21:18.854603 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:18.965688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.536s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:18.966216 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:21:19.252488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:19.252991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:19.258942 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:21:19.259347 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Claim successful on node np0000000669
May 13 04:21:19.478236 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:21:19.478236 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:21:19.478236 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:19.478498 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:19.586652 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:21:19.741662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:19.863924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1fe128d8-71ce-4488-bb47-7b81e7be530e tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.073s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:19.979221 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:21:20.191373 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Successfully created port: 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:21:20.454534 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003844529996968049 future=<Future at 0x7a463c0c0c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:20.455664 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646065.4540431, 964efe52-53ac-408f-a011-b8e49c5b6fd4 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:20.455966 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:20.456203 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] VM Stopped (Lifecycle Event)
May 13 04:21:20.457566 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.205076923999968 future=<Future at 0x7a463c0fe540 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:20.457900 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.204792834000273 future=<Future at 0x7a463c0fe540 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:20.484617 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:21:20.888854 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Successfully updated port: 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:21:20.916291 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:20.916595 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:20.949234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:20.949388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing instance network info cache due to event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:20.949556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:20.949650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:20.949781 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:20.959611 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 964efe52-53ac-408f-a011-b8e49c5b6fd4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:21.391863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:21.426659 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:21.451674 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:21.493781 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:21:21.494775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:21:21.495002 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Creating image(s)
May 13 04:21:21.495583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:21.495757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:21.496217 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:21.496889 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:21.499503 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:21.504348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:21.536868 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:21.618462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:21.620250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:21.621161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:21.621808 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:21.627278 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:21.627788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:21.731830 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:21.733787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:21.734874 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:21.803438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk 1073741824" returned: 0 in 0.069s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:21.804126 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:21.804629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:21.937245 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:21.937659 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:21:21.941294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.136s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:21.941853 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:21:21.942336 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:22.049707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:22.049707 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:21:22.050122 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:21:22.050122 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Ensure instance console log exists: /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:21:22.050407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:22.050685 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:22.050891 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:22.179923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:22.235388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1abe1564-a002-42e7-9afd-b59f52d3077e req-8ed96b17-ed54-4cda-9aef-ad9a7a3f0824 service nova] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:22.235727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:22.236019 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:21:22.462368 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:21:22.462540 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:21:22.462956 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:22.463197 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:22.553202 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:21:22.897146 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:22.970525 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:21:23.084869 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:23.085908 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:21:23.141530 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Successfully created port: 246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:21:23.250339 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:23.449788 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:23.479025 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:21:23.820395 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Successfully updated port: 246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:21:23.904754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-changed-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:23.905682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Refreshing instance network info cache due to event network-changed-246df767-9479-4cb6-abe2-7b5641bb9fee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:23.905682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] Acquiring lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:23.905682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] Acquired lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:23.905682 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Refreshing network info cache for port 246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:23.953445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:23.953784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance network_info: |[{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:21:23.956913 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start _get_guest_xml network_info=[{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:21:23.967850 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:23.970399 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:21:23.972083 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='bef8f03b-9d16-489d-904e-04fbce74b056'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646083.9715881) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:21:23.975404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:21:23.976442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:21:23.977751 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:21:23.978084 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:21:23.980700 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:21:23.981261 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:21:23.981493 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:21:23.981623 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:21:23.981795 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:21:23.981945 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:21:23.982088 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:21:23.982291 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:21:23.982759 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:21:23.983128 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:21:23.983314 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:21:23.983508 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:21:23.991817 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Booting with volume fd8ff985-d9e6-49a4-8bf7-647b5f234dea at /dev/vda
May 13 04:21:24.010031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:21:24.010332 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:24.011223 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:24.012465 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:24.055705 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:24.073751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:24.084813 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:24.084813 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:24.115354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:24.176024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:24.176526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:24.193889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:24.198002 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91'] 
May 13 04:21:24.198002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:24.198002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:24.198002 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:24.198002 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating existing volume attachment record: 2694176b-fd5b-474a-b1ff-e4baf6e227a2 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:24.323721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:24.410243 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:24.517555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] End _get_guest_xml xml=<domain type="qemu">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <uuid>bef8f03b-9d16-489d-904e-04fbce74b056</uuid>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <name>instance-00000030</name>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-0</nova:name>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:21:23</nova:creationTime>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         <nova:port uuid="3d23fe88-4cef-4e24-9b41-83156fdda4d0">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <system>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="serial">bef8f03b-9d16-489d-904e-04fbce74b056</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="uuid">bef8f03b-9d16-489d-904e-04fbce74b056</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </system>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <os>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </os>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <features>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </features>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   <devices>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:9e:60:9d"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <target dev="tap3d23fe88-4c"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </interface>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/console.log" append="off"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </serial>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <video>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </video>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </rng>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:   </devices>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]: </domain>
May 13 04:21:24.517555 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:21:24.519822 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Preparing to wait for external event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:21:24.519822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:24.519913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:24.520054 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:24.521367 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:24.524824 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:21:24.526082 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:24.527006 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:24.527464 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:21:24.529209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.529628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:24.530021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:21:24.531600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.532373 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e985d4d0-5ca9-5037-a21d-a9780c90f82e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:24.534272 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.535208 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:24.537788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.540047 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.540216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d23fe88-4c, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:24.540667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d23fe88-4c, col_values=(('qos', UUID('e127b29f-436d-43f7-95db-90b979a146c5')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:24.540882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d23fe88-4c, col_values=(('external_ids', {'iface-id': '3d23fe88-4cef-4e24-9b41-83156fdda4d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:60:9d', 'vm-uuid': 'bef8f03b-9d16-489d-904e-04fbce74b056'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:24.544633 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:24.550363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.551705 np0000000669 nova-compute[97951]: INFO os_vif [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c')
May 13 04:21:24.598741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:24.598741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:24.602202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:24.602627 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:21:24.743199 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:24.762574 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:25.265651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-267377b8-a1e1-4f01-90c7-b6c3929d0273 req-859a088b-5b4b-41f9-84bf-b5f2def3b0b1 service nova] Releasing lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:25.266046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:25.266127 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:21:25.659137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:21:25.660764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:25.706001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:25.706261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:25.759423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:25.759938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:25.842664 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:25.862429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:25.863202 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000030, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config'
May 13 04:21:25.866910 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:25.962272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:25.962869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.052309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.056136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.088504 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:26.095958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:26.096147 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:26.096368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:9e:60:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:26.099914 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Using config drive
May 13 04:21:26.187426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.187860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.218557 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Detaching volume 595c3361-04e6-40f7-a9bb-26ac48af4355
May 13 04:21:26.279078 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating instance_info_cache with network_info: [{"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:26.289860 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Attempting to driver detach volume 595c3361-04e6-40f7-a9bb-26ac48af4355 from mountpoint /dev/vdc
May 13 04:21:26.296626 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found disk vdc by alias ua-595c3361-04e6-40f7-a9bb-26ac48af4355 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:26.297623 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Found disk vdc by alias ua-595c3361-04e6-40f7-a9bb-26ac48af4355 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:26.297755 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Attempting to detach device vdc from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:26.298020 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <alias name="ua-595c3361-04e6-40f7-a9bb-26ac48af4355"/>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <serial>595c3361-04e6-40f7-a9bb-26ac48af4355</serial>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:26.298020 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:26.304838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.313011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:21:26.313120 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:21:26.314884 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.328485 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully detached device vdc from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the persistent domain config.
May 13 04:21:26.328873 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] (1/8): Attempting to detach device vdc with device alias ua-595c3361-04e6-40f7-a9bb-26ac48af4355 from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:26.329522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <alias name="ua-595c3361-04e6-40f7-a9bb-26ac48af4355"/>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <serial>595c3361-04e6-40f7-a9bb-26ac48af4355</serial>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:26.329522 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:26.353480 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:21:26.355143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:21:26.355478 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Creating image(s)
May 13 04:21:26.355839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:21:26.356418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:21:26.356561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:26.356901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:26.357082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:26.407402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.409871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.507911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.517898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.612461 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:26.638377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:26.655629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.659413 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.675719 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.013022797999838076 future=<Future at 0x7a463c0fe540 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:26.677429 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:26.681022 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646071.6624599, 4b2f0d86-83ca-4a76-8950-cd2768dedf23 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:26.684348 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] VM Stopped (Lifecycle Event)
May 13 04:21:26.772024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.778635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.804995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:26.806431 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance network_info: |[{"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:21:26.809660 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Start _get_guest_xml network_info=[{"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'serial': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea'}, 'disk_bus': 'virtio', 'attachment_id': '2694176b-fd5b-474a-b1ff-e4baf6e227a2', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:21:26.823170 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:21:26.825613 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-353390139', uuid='e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646086.8250864) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:21:26.829288 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:21:26.829709 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:21:26.831405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:21:26.831555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:21:26.833194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:21:26.833194 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:21:26.833367 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:21:26.833406 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:21:26.833520 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:21:26.834214 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:21:26.834309 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:21:26.834481 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:21:26.834580 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:21:26.834696 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:21:26.834845 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:21:26.835007 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:21:26.847624 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Creating config drive at /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config
May 13 04:21:26.853721 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:26.854150 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:26.854358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:26.854954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:26.855726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:26.858313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0rusk6m6 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.874963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:26.876081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:26.876465 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:26.877557 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:26.878402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:26.878868 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:26.895288 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:26.895288 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:26.900422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:26.900422 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:26.906131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.906684 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:26.923839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea] added
May 13 04:21:26.923839 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:26.923839 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:26.923839 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:26.923839 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:26.923839 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:26.923839 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:26.924131 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:26.924697 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0481(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:26.925315 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:26.926064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0rusk6m6" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea] added
May 13 04:21:26.927318 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:26.927318 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0484(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:26.927318 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:26.977334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:26.977633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:27.005734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:27.015960 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:21:27.017752 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646087.0160148, fd379e34-a21d-45c7-99e6-6f77272bc1ce => ua-595c3361-04e6-40f7-a9bb-26ac48af4355> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:27.018114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:27.018519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-595c3361-04e6-40f7-a9bb-26ac48af4355 for instance fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:27.037779 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully detached device vdc from instance fd379e34-a21d-45c7-99e6-6f77272bc1ce from the live domain config.
May 13 04:21:27.039298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:27.039947 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:27.040109 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:27.061345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:27.061345 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=11714MB free_disk=72.94430541992188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:21:27.061345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:27.061345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:27.192224 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4b2f0d86-83ca-4a76-8950-cd2768dedf23] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:27.482268 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:27.517611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.552491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.554743 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.647232 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.648391 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.658555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:27.926354 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:27.927642 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:27.943694 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:27.943694 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:27.955960 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:27.955960 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:27.960952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:27.971901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:27.986592 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Ignoring supplied device name: /dev/vdb
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.987744 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.988059 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.995182 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:27.995525 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:28.027025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.40.100,3260]
May 13 04:21:28.027025 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.40.100,3260] successful.
May 13 04:21:28.027025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:28.041506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:28.050355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.50.100,3260]
May 13 04:21:28.050355 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.50.100,3260] successful.
May 13 04:21:28.050355 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.064509 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.065008 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:28.065421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:28.065421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:28.066351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:28.067779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('11', '-', '-', 0) found on session 104 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:28.067985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:28.086716 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:28.086716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:28.088965 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('12', '-', '-', 0) found on session 105 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:28.088965 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:28.099271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 104 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:28.099499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:28.104087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 105 and hctl ['12', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:28.133423 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.133576 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance fd379e34-a21d-45c7-99e6-6f77272bc1ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.133720 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.133907 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.134057 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.134494 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.134494 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.134795 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bef8f03b-9d16-489d-904e-04fbce74b056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.135057 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:21:28.135307 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:21:28.135507 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:21:27 up 35 min,  2 users,  load average: 8.69, 7.99, 4.80\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '4', 'io_workload': '2', 'num_proj_15743507272b4687a350f2974d99a4ae': '1', 'num_proj_016554a7d54c4781a53b6ddb1f2e81e2': '1', 'num_proj_e227d582564c4ef7b5ab8d19583df520': '1', 'num_proj_65a23aa4db5e48eeadf67eec77fd305c': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:21:28.490556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:28.632342 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646088.6318257, bef8f03b-9d16-489d-904e-04fbce74b056 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:28.636342 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Started (Lifecycle Event)
May 13 04:21:28.683179 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:28.683458 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:28.780074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:29.104762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 105 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:29.104842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:29.135191 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:29.138176 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646089.137959, bef8f03b-9d16-489d-904e-04fbce74b056 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:29.138301 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Paused (Lifecycle Event)
May 13 04:21:29.186330 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:29.413934 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3b4f8906-9065-4302-83e3-c46d8cf88fe0 req-afcba6d8-9ac3-464b-a9ab-808e57198056 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:29.414125 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3b4f8906-9065-4302-83e3-c46d8cf88fe0 req-afcba6d8-9ac3-464b-a9ab-808e57198056 service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:29.414230 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3b4f8906-9065-4302-83e3-c46d8cf88fe0 req-afcba6d8-9ac3-464b-a9ab-808e57198056 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:29.414872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3b4f8906-9065-4302-83e3-c46d8cf88fe0 req-afcba6d8-9ac3-464b-a9ab-808e57198056 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:29.414872 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3b4f8906-9065-4302-83e3-c46d8cf88fe0 req-afcba6d8-9ac3-464b-a9ab-808e57198056 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Processing event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:29.415728 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:29.418782 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:29.425673 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance spawned successfully.
May 13 04:21:29.426073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:29.542879 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:29.548174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:29.548174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:29.548261 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Attaching volume 97c37cea-2ee3-4bfa-b782-a46c173fed0a to /dev/vdb
May 13 04:21:29.596955 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:29.608013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:29.631258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:29.649793 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:29.656334 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646089.6556973, bef8f03b-9d16-489d-904e-04fbce74b056 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:29.656684 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Resumed (Lifecycle Event)
May 13 04:21:29.682250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:29.682509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:29.692624 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:29.693841 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91', 'fe80::fc16:3eff:fe9e:609d'] 
May 13 04:21:29.693975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:29.694033 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:29.694216 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:29.694419 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating existing volume attachment record: 9e2df182-99ba-4a86-bccc-38de5f55ef36 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:29.697705 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:21:29.697955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.637s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:29.699384 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:21:29.745768 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:29.894948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 3300000009cb570cf for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:29.895304 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:29.895504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000009cb570cf', 'path': '/dev/dm-6', 'multipath_id': '3300000009cb570cf'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:29.895643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009cb570cf', 'path': '/dev/dm-6', 'multipath_id': '3300000009cb570cf'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:29.896275 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.856s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:29.896733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595c3361-04e6-40f7-a9bb-26ac48af4355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:29.896910 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:29.932036 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355 (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:29.932405 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:29.932405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:29.932657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '102')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:29.934140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355', '103')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:29.937836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c6536a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'): ({'sdo'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:29.937836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Removing multipathed devices sdn, sdo {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:29.938071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Flush multipath device 330000000f218f03b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:29.941339 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.941339 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.941339 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.941520 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.941824 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.942388 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:29.971865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:30.015871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:30.052314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:30.052314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:30.055116 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:30.071681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:30.072521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:30.086723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.126235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.40.100,3260]
May 13 04:21:30.126235 np0000000669 nova-compute[97951]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.40.100,3260] successful.
May 13 04:21:30.126235 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.147345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.160962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.162907 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:30.167925 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:30.203536 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.50.100,3260]
May 13 04:21:30.203536 np0000000669 nova-compute[97951]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-595c3361-04e6-40f7-a9bb-26ac48af4355, portal: 192.168.50.100,3260] successful.
May 13 04:21:30.203536 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.219218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.222343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:30.222343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== disconnect_volume: return (3180ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:30.222343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:30.265144 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:30.265576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:30.265576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:30.266009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:30.266195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:30.281500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:30.282431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:30.283465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:30.283740 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:30.284172 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:30.284451 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:30.296424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:30.296424 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.306379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:30.306379 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.316070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a] added
May 13 04:21:30.316070 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:30.316070 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:30.316070 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:30.316070 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:30.316070 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:30.316070 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.317347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:30.317347 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:30.317347 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a] added
May 13 04:21:30.323122 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:30.323122 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:30.323122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:30.324108 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:30.324459 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:30.403719 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-353390139',display_name='tempest-TestVolumeBootPattern-server-353390139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-353390139',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzsMt94Lj51QX09kQIu7xDVBbvwheiJzIJ4GC1r+thNXd9P07d3800K1mRZDlY+WFrUkDXHNTxjta1zVTC3mur6AM9EZ393zHsWhKlt7xfJbRvMEmbIaCQ4NUJUGoPY9A==',key_name='tempest-keypair-1127217375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-6qudncr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:21:30.403988 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:30.404690 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:30.405619 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:30.450857 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Took 8.96 seconds to spawn the instance on the hypervisor.
May 13 04:21:30.451138 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:30.670989 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:30.778184 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'flavor' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:30.908765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] End _get_guest_xml xml=<domain type="qemu">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <uuid>e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf</uuid>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <name>instance-00000031</name>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-353390139</nova:name>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:21:26</nova:creationTime>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         <nova:port uuid="246df767-9479-4cb6-abe2-7b5641bb9fee">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <system>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="serial">e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="uuid">e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </system>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <os>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </os>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <features>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </features>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   <devices>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/disk.config"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <alias name="ua-fd8ff985-d9e6-49a4-8bf7-647b5f234dea"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-6"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <serial>fd8ff985-d9e6-49a4-8bf7-647b5f234dea</serial>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:65:35:27"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <target dev="tap246df767-94"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </interface>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/console.log" append="off"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </serial>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <video>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </video>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </rng>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:   </devices>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]: </domain>
May 13 04:21:30.908765 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Preparing to wait for external event network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-353390139',display_name='tempest-TestVolumeBootPattern-server-353390139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-353390139',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzsMt94Lj51QX09kQIu7xDVBbvwheiJzIJ4GC1r+thNXd9P07d3800K1mRZDlY+WFrUkDXHNTxjta1zVTC3mur6AM9EZ393zHsWhKlt7xfJbRvMEmbIaCQ4NUJUGoPY9A==',key_name='tempest-keypair-1127217375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-6qudncr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.912098 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:30.913008 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:21:30.913336 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.913502 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b294ceaf-5563-5008-be9d-784f3efc899f', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:30.914367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.915354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:30.915590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.917962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.918118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap246df767-94, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:30.918429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap246df767-94, col_values=(('qos', UUID('eeeeb222-13ca-4fed-ae6f-fb8e3d16e6ff')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:30.918585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap246df767-94, col_values=(('external_ids', {'iface-id': '246df767-9479-4cb6-abe2-7b5641bb9fee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:35:27', 'vm-uuid': 'e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:30.919581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.921182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:30.925896 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.926758 np0000000669 nova-compute[97951]: INFO os_vif [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94')
May 13 04:21:30.942276 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:30.964573 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Took 14.85 seconds to build instance.
May 13 04:21:31.317435 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:31.324954 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:31.335247 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:31.335247 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:31.342187 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:31.342187 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.349405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.357771 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.368216 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.368527 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.376496 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.376738 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:31.421133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.50.100,3260]
May 13 04:21:31.421133 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.50.100,3260] successful.
May 13 04:21:31.421133 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.429253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.40.100,3260]
May 13 04:21:31.429253 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.40.100,3260] successful.
May 13 04:21:31.429253 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.435778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.449868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.457425 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.458229 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:31.458229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:31.459392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] HCTL ('13', '-', '-', 0) found on session 106 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:31.459492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:31.467056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-44638165-41a6-4549-baa5-12bf2325c937 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.363s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.470541 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:31.470800 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:31.471041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:31.471665 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:31.472422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] HCTL ('14', '-', '-', 0) found on session 107 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:31.472682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:31.481731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching for a device in session 106 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:31.481731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:31.499594 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Searching for a device in session 107 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:31.499668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:31.505709 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:31.505977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:31.506192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:31.508117 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:31.508460 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:31.508711 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e91c18ce-ed38-4d2b-b2bd-b70f776bc13e req-847f6471-6eb8-4b74-a1f6-2b6f2da88c11 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received unexpected event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with vm_state active and task_state None.
May 13 04:21:31.694419 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.696380 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.697159 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.698880 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.701499 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.701732 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:21:31.701921 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:21:31.702523 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.38 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:21:31.786421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-95fd4e56-02b6-464b-bb3f-a06a123b70b5 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.080s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:31.920300 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:32.284243 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:21:32.459657 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:32.459846 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:32.460101 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:65:35:27, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:32.460563 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Using config drive
May 13 04:21:32.674307 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:32.674561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:32.967701 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:33.170339 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:33.170629 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing instance network info cache due to event network-changed-55e9c21b-9829-40e1-98cc-037540f69e41. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:33.170896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] Acquiring lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:33.171178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] Acquired lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:33.171336 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Refreshing network info cache for port 55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:33.182392 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:33.256037 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Creating config drive at /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/disk.config
May 13 04:21:33.261542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpip6svo3_ {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:33.301862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found WWN 330000000dedce61e for multipath device dm-9 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:33.302851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:33.303353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000dedce61e', 'path': '/dev/dm-9', 'multipath_id': '330000000dedce61e'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:33.303474 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dedce61e', 'path': '/dev/dm-9', 'multipath_id': '330000000dedce61e'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:33.314099 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:33.337779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpip6svo3_" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:33.634564 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:33.634845 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing instance network info cache due to event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:33.635097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:33.636299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:33.636299 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:33.686215 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:33.819723 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Attempting to attach volume 97c37cea-2ee3-4bfa-b782-a46c173fed0a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:33.830710 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:   <alias name="ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a"/>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:   <serial>97c37cea-2ee3-4bfa-b782-a46c173fed0a</serial>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:33.830710 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:33.852780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:33.887569 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:33.889501 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.138692 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:34.142242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.194138 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:34.270673 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.280512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.311789 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.444154 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.558431 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:34.750088 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:34.826589 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updated VIF entry in instance network info cache for port 55e9c21b-9829-40e1-98cc-037540f69e41. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:34.826912 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [{"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:34.843740 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:35.015527 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updated VIF entry in instance network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:35.015975 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:35.213422 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646095.213068, e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:35.213812 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] VM Started (Lifecycle Event)
May 13 04:21:35.222044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:35.222580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:35.222766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:35.223065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:35.223982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:35.226699 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Terminating instance
May 13 04:21:35.250119 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:35.250289 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing instance network info cache due to event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:35.250449 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:35.250605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:35.250708 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:35.312274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:35.312503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:35.312692 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Attaching volume f8d6ae12-9675-44bd-959f-58e367b55375 to /dev/vdb
May 13 04:21:35.330763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-60344ee9-b44d-4cf5-ad99-03e72ed8b68b req-8c56abe6-4fc8-4015-8e3f-8e7b7fac1588 service nova] Releasing lock "refresh_cache-bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:35.348362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:35.348534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:35.362199 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:35.376383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:35.400200 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:35.443892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:35.444258 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:35.452667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:35.454818 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fed8:74d9', 'fe80::24c1:ddff:fe77:fbdb', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe65:3527', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:21:35.454986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:35.455122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:35.455571 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:35.456196 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating existing volume attachment record: 892d2e3d-97cb-48c1-a32c-e70b1153ff81 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:35.518218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f42d80ad-1a15-4f33-827a-1e7380f43309 req-5c73b5c8-d2b5-4b49-b171-b75ba44c6aba service nova] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:35.686436 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:35.686541 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:35.686624 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:35.686726 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] No VIF found with MAC fa:16:3e:13:12:82, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:35.721182 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:35.725452 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:35.727040 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing instance network info cache due to event network-changed-36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:35.727040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] Acquiring lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:35.727040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] Acquired lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:35.728492 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Refreshing network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:35.731041 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:21:35.733811 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646095.7334747, e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:35.735836 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] VM Paused (Lifecycle Event)
May 13 04:21:35.753672 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:35.757444 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:35.761123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:35.787778 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:35.817660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:35.819801 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:35.850616 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:21:35.920260 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.075978 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd071d2d8-dde9-47d3-97ea-6cee2c5b72d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'serial': 'f8d6ae12-9675-44bd-959f-58e367b55375'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:21:36.081529 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:36.081866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:36.082352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:36.082745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:36.083113 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:36.097409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:36.098300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:36.102124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:36.102427 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:36.109894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.012s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:36.110216 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:36.124364 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Instance destroyed successfully.
May 13 04:21:36.124497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:36.124497 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:36.126667 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lazy-loading 'resources' on Instance uuid fd379e34-a21d-45c7-99e6-6f77272bc1ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:36.131463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:36.131463 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:36.141428 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375] added
May 13 04:21:36.141428 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:36.141428 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:36.141428 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:36.141428 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:36.141428 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:36.141428 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:36.141837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:36.141837 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:36.142029 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:36.146609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375] added
May 13 04:21:36.146609 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:36.146609 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:36.146609 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:36.146609 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:36.146609 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:36.146609 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:36.146938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:36.147083 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:36.147257 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:36.236097 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:36.242517 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:36.249790 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:36.282727 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:36.430642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:36.430859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:36.434839 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:21:36.434972 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Claim successful on node np0000000669
May 13 04:21:36.470134 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updated VIF entry in instance network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:36.470524 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:36.630377 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-139715745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testinstanceswithcindervolumes-server-139715745',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc0e0MnGGp3UlrPQ3YLc8kNyzmLWl8BaZh2oIgU/oofD2hchAKM9YWnkdB0Ip2l8FBUkfG/nFaRhY6juYhRunv66LnTTnk77dX5L54LT2prJ50H78XDVpAOAEisQ5f/8g==',key_name='tempest-TestInstancesWithCinderVolumes-1412390341',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:03Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15743507272b4687a350f2974d99a4ae',ramdisk_id='',reservation_id='r-9owiwkqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-471064079',owner_user_name='tempest-TestInstancesWithCinderVolumes-471064079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:04Z,user_data=None,user_id='479dc75c23e64df8b8df396b3c077c26',uuid=fd379e34-a21d-45c7-99e6-6f77272bc1ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:21:36.632346 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converting VIF {"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:36.632346 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:36.632346 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:21:36.634342 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.634617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36fc68cd-73, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:36.636477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.637316 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:36.638165 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.639519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.639735 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fdc3140-5d87-4ba6-824f-f02b23e06e2b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:36.640367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.640949 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:36.641392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:36.644290 np0000000669 nova-compute[97951]: INFO os_vif [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:74:d9,bridge_name='br-int',has_traffic_filtering=True,id=36fc68cd-737b-450b-972a-7e314187c3cd,network=Network(7c2c0935-b3f4-4dc7-bd78-871000263a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fc68cd-73')
May 13 04:21:36.646101 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:36.646101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:36.646101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:36.666715 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:36.761522 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:36.761964 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999765202999697 future=<Future at 0x7a463c7a1280 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:36.762684 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99907771199969 future=<Future at 0x7a463c7a1280 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:36.762831 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998910920999606 future=<Future at 0x7a463c7a1280 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:36.808350 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updated VIF entry in instance network info cache for port 36fc68cd-737b-450b-972a-7e314187c3cd. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:36.808350 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [{"id": "36fc68cd-737b-450b-972a-7e314187c3cd", "address": "fa:16:3e:d8:74:d9", "network": {"id": "7c2c0935-b3f4-4dc7-bd78-871000263a23", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-2050875898-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15743507272b4687a350f2974d99a4ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fc68cd-73", "ovs_interfaceid": "36fc68cd-737b-450b-972a-7e314187c3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:36.975784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:36.976019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:36.976277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:36.976533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:36.976657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:36.976851 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Processing event network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:36.977072 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:36.977258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:36.978196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:36.978196 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:36.978196 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] No waiting events found dispatching network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:36.978196 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-eaa5f053-d8b5-422c-8eb1-c385b379e11d req-7304b484-a481-4a8c-b4e8-b925b2401fa7 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received unexpected event network-vif-plugged-246df767-9479-4cb6-abe2-7b5641bb9fee for instance with vm_state building and task_state spawning.
May 13 04:21:36.978751 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:36.984355 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646096.9839828, e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:36.984531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] VM Resumed (Lifecycle Event)
May 13 04:21:36.985736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:36.990888 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance spawned successfully.
May 13 04:21:36.992253 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:37.142492 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:37.147926 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:37.158547 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:37.158547 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:37.167535 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:37.167535 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.173583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.181603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.195413 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.195787 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.204642 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.204845 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:37.257159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.40.100,3260]
May 13 04:21:37.257159 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.40.100,3260] successful.
May 13 04:21:37.257159 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.257775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-74b859bb-6eb7-4b9c-8515-81377e6ff4ff tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.710s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:37.269098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.50.100,3260]
May 13 04:21:37.269098 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.50.100,3260] successful.
May 13 04:21:37.269098 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.278705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.289492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.305270 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.305676 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:37.306026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:37.306182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:37.308126 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('15', '-', '-', 0) found on session 108 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:37.308280 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.311460 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:37.311836 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:37.312147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:37.312147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:37.313680 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('16', '-', '-', 0) found on session 109 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:37.313839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:37.314280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-27a465d9-9ab5-488f-b96a-2eb7440a895c req-74e33857-0eb5-47ee-aaff-7da568b58b1c service nova] Releasing lock "refresh_cache-fd379e34-a21d-45c7-99e6-6f77272bc1ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:37.327001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 108 and hctl ['15', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:37.335239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 109 and hctl ['16', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:37.487916 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:37.490236 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.507750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] No waiting events found dispatching network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:37.796487 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:37.797742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Acquiring lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:37.798095 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:37.799044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:37.799044 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] No waiting events found dispatching network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:37.799044 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3142b1e6-3950-4cba-a3ec-90a3be59011d req-2a88bb34-d355-451c-8308-7b1c53429bf6 service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-unplugged-36fc68cd-737b-450b-972a-7e314187c3cd for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:37.992554 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:38.022969 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Took 11.67 seconds to spawn the instance on the hypervisor.
May 13 04:21:38.023120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:38.126220 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:38.126515 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:38.327210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 108 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:38.327688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:38.335654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 109 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:38.335950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:38.538928 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Took 19.35 seconds to build instance.
May 13 04:21:38.629709 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:39.041811 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6171be6a-13e0-4576-ba80-53b3eadcec77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.858s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:39.099229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:21:39.139193 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.708s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:39.139784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:21:39.650023 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:21:39.650468 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:21:39.650468 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:39.650743 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:39.753078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:39.772985 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:21:39.879569 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-changed-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:39.881398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Refreshing instance network info cache due to event network-changed-246df767-9479-4cb6-abe2-7b5641bb9fee. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:39.882524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] Acquiring lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:39.882625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] Acquired lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:39.882723 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Refreshing network info cache for port 246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:39.888536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:39.888974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:40.089631 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:21:40.123404 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found WWN 33000000058921f63 for multipath device dm-10 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:40.123832 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:40.124257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.478s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:40.124620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61038aa7-c529-45dd-8532-b9c495ed9681', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:40.125302 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:40.125884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': '33000000058921f63', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '33000000058921f63'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:40.128514 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058921f63', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '33000000058921f63'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:40.130546 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:21:40.130801 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:40.131222 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:40.132489 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7a463c7156a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'd071d2d8-dde9-47d3-97ea-6cee2c5b72d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'serial': 'f8d6ae12-9675-44bd-959f-58e367b55375'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:21:40.132781 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.cryptsetup [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 13 04:21:40.133083 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97951) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 04:21:40.133350 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.cryptsetup [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] opening encrypted volume /dev/dm-10 {{(pid=97951) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 13 04:21:40.150209 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:40.178405 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681 (non-flash)
May 13 04:21:40.178915 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:40.178915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:40.179300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '89')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:40.180725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681', '90')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:40.181803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c651120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:40.182088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Removing multipathed devices sde, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:40.182430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Flush multipath device 3300000001243ad3b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:40.232749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:40.284643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:40.296739 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:40.332749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:40.333262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:40.334286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:40.346853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:40.347059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:40.361453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.386198 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Successfully created port: 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:21:40.393837 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:40.397281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:21:40.402883 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.40.100,3260]
May 13 04:21:40.402883 np0000000669 nova-compute[97951]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.40.100,3260] successful.
May 13 04:21:40.402883 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.429070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.452380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.498277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.50.100,3260]
May 13 04:21:40.498277 np0000000669 nova-compute[97951]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-61038aa7-c529-45dd-8532-b9c495ed9681, portal: 192.168.50.100,3260] successful.
May 13 04:21:40.498277 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.530040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:40.530400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:40.530474 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] <== disconnect_volume: return (3884ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:40.530589 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:40.531118 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Deleting instance files /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce_del
May 13 04:21:40.531596 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Deletion of /opt/stack/data/nova/instances/fd379e34-a21d-45c7-99e6-6f77272bc1ce_del complete
May 13 04:21:40.654087 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:21:40.801555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Attempting to attach volume f8d6ae12-9675-44bd-959f-58e367b55375 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:40.803071 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:   <alias name="ua-f8d6ae12-9675-44bd-959f-58e367b55375"/>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:   <serial>f8d6ae12-9675-44bd-959f-58e367b55375</serial>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:40.803071 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:40.894680 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:40.973750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:40.973958 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:40.982956 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:21:40.983302 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Claim successful on node np0000000669
May 13 04:21:41.025542 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Successfully updated port: 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:21:41.040935 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Took 5.31 seconds to destroy the instance on the hypervisor.
May 13 04:21:41.041662 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:21:41.042103 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:21:41.042278 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:21:41.042577 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:41.093203 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updated VIF entry in instance network info cache for port 246df767-9479-4cb6-abe2-7b5641bb9fee. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:41.093676 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating instance_info_cache with network_info: [{"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:41.103258 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:41.106349 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing instance network info cache due to event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:41.107406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:41.107406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:41.107406 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:41.185336 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:41.528207 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:41.596171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ff96267-e626-485e-a37b-31269f2cb209 req-e8a5148f-b566-4591-b274-9a2f1c5b1e81 service nova] Releasing lock "refresh_cache-e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:41.613031 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:41.642636 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Creating image(s)
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:41.667346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:41.668576 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:41.671900 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:41.674394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:41.733104 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:41.804735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:41.805645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:41.806045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:41.806676 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:41.810838 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:21:41.811299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:41.907605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:41.908171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:41.947993 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:41.970895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk 1073741824" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:41.971402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:41.971819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:41.991353 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:42.072399 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:42.072734 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:21:42.072967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:42.165856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:42.166211 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:21:42.166698 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:21:42.166888 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Ensure instance console log exists: /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:21:42.167142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:42.167349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:42.167488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:42.451951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3755eae-6981-46a9-8e32-c66ff0ea27db req-f80c4fba-5bbd-450c-ac58-18b44675e850 service nova] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:42.453741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:42.453741 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:21:42.504176 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Took 1.46 seconds to deallocate network for instance.
May 13 04:21:42.511404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:42.511517 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:42.511655 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:42.511797 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:35:d0:2f, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:42.657639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:42.657639 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:43.064454 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:43.160414 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:43.199444 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Took 0.69 seconds to detach 1 volumes for instance.
May 13 04:21:43.213848 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1abc402d-df79-47c2-9ebd-db2fdbadd01b req-ceec5189-15c2-4b5a-9a8c-6e426a617cde service nova] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Received event network-vif-deleted-36fc68cd-737b-450b-972a-7e314187c3cd {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:43.267091 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:43.489346 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:43.668852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.695s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:43.669308 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:21:43.710310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:43.712035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:43.894834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:43.896587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:43.990471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:43.990471 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance network_info: |[{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:21:43.992543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start _get_guest_xml network_info=[{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:21:43.997410 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:21:43.998694 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='3df1fc73-4ebd-40cf-b61f-2e4d911aa81f'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646103.9982839) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:21:43.999893 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:21:44.000308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:21:44.001317 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:21:44.001375 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:21:44.002723 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:21:44.002773 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:21:44.003024 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:21:44.003558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:21:44.003558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:21:44.003558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:21:44.003558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:21:44.003813 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:21:44.003813 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:21:44.004442 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:21:44.004442 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:21:44.004442 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:21:44.020050 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:21:44.021420 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:44.021420 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:44.023468 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:44.078492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-20b59386-ab9d-4b2c-8e61-ef4db4830473 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.766s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:44.179400 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:21:44.180488 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:21:44.180638 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:44.180895 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:44.288937 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f50ff3fb0b4c41dea9c79fe8d54cf794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e642c6f91a844b89aaaca335f536052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:21:44.326004 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:44.326237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:44.403791 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lazy-loading 'flavor' on Instance uuid 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:44.443141 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:44.443429 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:44.526816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <uuid>3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</uuid>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <name>instance-00000032</name>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-1</nova:name>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:21:43</nova:creationTime>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         <nova:port uuid="0faab3e7-86ec-4f70-8d30-d950d7dd4592">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <system>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="serial">3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="uuid">3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </system>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <os>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </os>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <features>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </features>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   <devices>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:08:ed:36"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <target dev="tap0faab3e7-86"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </interface>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/console.log" append="off"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </serial>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <video>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </video>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </rng>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:   </devices>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]: </domain>
May 13 04:21:44.526816 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Preparing to wait for external event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:21:44.529895 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.530840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:44.530840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:21:44.533285 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.538833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '043ed3b6-5288-52d8-b148-cbca6aba5f3a', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:44.538833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.538833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:44.542101 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.543121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.543365 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0faab3e7-86, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:44.543785 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0faab3e7-86, col_values=(('qos', UUID('a8a76a64-b4bd-4fc8-9de9-04ed9e58ebf7')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:44.544021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0faab3e7-86, col_values=(('external_ids', {'iface-id': '0faab3e7-86ec-4f70-8d30-d950d7dd4592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ed:36', 'vm-uuid': '3df1fc73-4ebd-40cf-b61f-2e4d911aa81f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:44.547810 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.547810 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:44.554336 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.555815 np0000000669 nova-compute[97951]: INFO os_vif [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86')
May 13 04:21:44.683374 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:21:44.754683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:44.828808 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Detaching volume f8d6ae12-9675-44bd-959f-58e367b55375
May 13 04:21:44.891627 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Attempting to driver detach volume f8d6ae12-9675-44bd-959f-58e367b55375 from mountpoint /dev/vdb
May 13 04:21:44.912350 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Ignoring supplied device name: /dev/vdb
May 13 04:21:44.925802 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'd071d2d8-dde9-47d3-97ea-6cee2c5b72d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'serial': 'f8d6ae12-9675-44bd-959f-58e367b55375'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:21:44.935927 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-f8d6ae12-9675-44bd-959f-58e367b55375 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:44.937260 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-f8d6ae12-9675-44bd-959f-58e367b55375 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:44.937454 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Attempting to detach device vdb from instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:44.937652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <alias name="ua-f8d6ae12-9675-44bd-959f-58e367b55375"/>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <serial>f8d6ae12-9675-44bd-959f-58e367b55375</serial>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:44.937652 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:44.946253 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:44.952367 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 from the persistent domain config.
May 13 04:21:44.954683 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] (1/8): Attempting to detach device vdb with device alias ua-f8d6ae12-9675-44bd-959f-58e367b55375 from instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:44.954683 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <alias name="ua-f8d6ae12-9675-44bd-959f-58e367b55375"/>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <serial>f8d6ae12-9675-44bd-959f-58e367b55375</serial>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:44.954683 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:44.987494 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Successfully created port: c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:21:45.189189 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:21:45.431714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.535s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:45.455775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.744s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:45.528385 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Deleted allocations for instance fd379e34-a21d-45c7-99e6-6f77272bc1ce
May 13 04:21:45.601732 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Successfully updated port: c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:21:45.627944 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646105.6275258, d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 => ua-f8d6ae12-9675-44bd-959f-58e367b55375> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:21:45.629101 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f8d6ae12-9675-44bd-959f-58e367b55375 for instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:45.631783 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 from the live domain config.
May 13 04:21:45.633433 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:21:45.633768 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:45.634039 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:21:45.634604 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7a461c619ca0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'd071d2d8-dde9-47d3-97ea-6cee2c5b72d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'serial': 'f8d6ae12-9675-44bd-959f-58e367b55375'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:21:45.634784 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.cryptsetup [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] closing encrypted volume /dev/dm-11 {{(pid=97951) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 13 04:21:45.670528 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:21:45.670528 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:45.670838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:45.671555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:45.671895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8d6ae12-9675-44bd-959f-58e367b55375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:21:45.673597 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:45.674017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:21:45.674250 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing instance network info cache due to event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:45.674501 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:45.674501 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:45.674623 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:45.699391 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Booting with volume f8925d06-5a4a-4aea-9692-34140d6314a0 at /dev/vda
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:45.701502 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375 (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:45.702313 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:45.702940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:21:45.703053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '108')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:45.706205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375', '109')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:21:45.706205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46481f19e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'): ({'sdk'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:21:45.706205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:21:45.706205 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flush multipath device 33000000058921f63 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:21:45.740744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:45.762331 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:45.779701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:45.790245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:21:45.805351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:45.839888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:21:45.840152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:21:45.842589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:21:45.857636 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:21:45.857942 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:21:45.858722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:45.861156 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:45.872775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe65:3527', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:45.876530 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating existing volume attachment record: 21a806e9-1c9e-47c7-9a3e-3e993af58487 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:45.911631 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.40.100,3260]
May 13 04:21:45.911631 np0000000669 nova-compute[97951]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.40.100,3260] successful.
May 13 04:21:45.911631 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:45.931696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:45.947061 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:45.985787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.50.100,3260]
May 13 04:21:45.985787 np0000000669 nova-compute[97951]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-f8d6ae12-9675-44bd-959f-58e367b55375, portal: 192.168.50.100,3260] successful.
May 13 04:21:45.985787 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:46.005641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:46.006923 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:46.007082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== disconnect_volume: return (336ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:46.007251 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:21:46.081999 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:46.082165 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:46.082277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:08:ed:36, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:46.083038 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Using config drive
May 13 04:21:46.103877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:46.177268 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:46.258771 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:46.442577 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:46.541122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc5266af-126f-44a4-b8bd-1860b9ce63c8 tempest-TestInstancesWithCinderVolumes-471064079 tempest-TestInstancesWithCinderVolumes-471064079-project-member] Lock "fd379e34-a21d-45c7-99e6-6f77272bc1ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.319s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:46.547983 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:46.547983 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:46.547983 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Attaching volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d to /dev/vdb
May 13 04:21:46.573644 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:46.589547 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:46.613741 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:46.632435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:46.654395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:46.702353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:46.702883 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:46.712772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:46.719758 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe35:d02f', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe65:3527', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:21:46.719916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:46.720422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:46.720813 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:46.721120 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating existing volume attachment record: fe09cdb7-eee2-4d95-a3f1-f3282e1d10da {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:46.771302 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Creating config drive at /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config
May 13 04:21:46.777993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16v5p1ej {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:46.853404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16v5p1ej" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:46.946955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d6c79d2e-5d5b-4951-b419-5fd4343a1231 req-06cfc420-591c-482f-8272-455ab56b5337 service nova] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:46.947678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:46.947872 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:21:47.286890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:47.287351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:47.287351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:47.290571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:47.290571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:47.305837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:47.306428 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:47.306913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:47.307144 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:47.307566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:47.308616 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:47.321613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:47.321613 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:47.331351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:47.331351 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:47.337107 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d] added
May 13 04:21:47.337107 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:47.337107 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:47.337107 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:47.337107 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:47.337107 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:47.337107 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:47.337363 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:47.337625 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:47.337839 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:47.343225 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d] added
May 13 04:21:47.343225 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:47.343225 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:47.343225 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:47.343225 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:47.343225 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:47.343225 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:47.343493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:47.343585 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:47.343750 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:47.368479 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:47.405525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:47.499343 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:47.524930 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:21:47.540933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:47.583671 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-114c7d29-0bc3-404b-acc1-aa7f64a4a3a8 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.257s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:47.618348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c46ef385-ac71-4015-ae56-3be33d42bead req-404e8bb6-10a8-4541-bafe-b0b94e1d9ec2 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:47.618674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c46ef385-ac71-4015-ae56-3be33d42bead req-404e8bb6-10a8-4541-bafe-b0b94e1d9ec2 service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:47.618841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c46ef385-ac71-4015-ae56-3be33d42bead req-404e8bb6-10a8-4541-bafe-b0b94e1d9ec2 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:47.618974 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c46ef385-ac71-4015-ae56-3be33d42bead req-404e8bb6-10a8-4541-bafe-b0b94e1d9ec2 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:47.619105 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c46ef385-ac71-4015-ae56-3be33d42bead req-404e8bb6-10a8-4541-bafe-b0b94e1d9ec2 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Processing event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:47.735182 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:47.944095 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:48.016157 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:21:48.017683 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:21:48.017982 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating image(s)
May 13 04:21:48.018417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:21:48.018549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Ensure instance console log exists: /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:21:48.018830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:48.018981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:48.019158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:48.338454 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:48.345867 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:48.366245 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:48.366245 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:48.380242 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:48.380242 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.393435 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.411903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.422358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.435624 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.436022 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:48.446947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:48.447273 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance network_info: |[{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:21:48.447997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start _get_guest_xml network_info=[{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e44483e5-9065-40b6-a4ea-12eb9109fea5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'serial': 'f8925d06-5a4a-4aea-9692-34140d6314a0'}, 'disk_bus': 'virtio', 'attachment_id': '21a806e9-1c9e-47c7-9a3e-3e993af58487', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:21:48.458401 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:21:48.460070 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-683657741', uuid='e44483e5-9065-40b6-a4ea-12eb9109fea5'), owner=OwnerMeta(userid='f50ff3fb0b4c41dea9c79fe8d54cf794', username='tempest-TestShelveInstance-592071318-project-member', projectid='7e642c6f91a844b89aaaca335f536052', projectname='tempest-TestShelveInstance-592071318'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646108.4595757) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:21:48.465567 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:21:48.466081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:21:48.469361 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:21:48.469361 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:21:48.469869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:21:48.470337 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:21:48.470746 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:21:48.470746 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:21:48.471377 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:21:48.471377 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:21:48.471377 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:21:48.471552 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:21:48.471648 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:21:48.471806 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:21:48.471963 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:21:48.472109 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:21:48.483689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.40.100,3260]
May 13 04:21:48.483689 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.40.100,3260] successful.
May 13 04:21:48.483689 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.486415 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:48.487833 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646108.4866588, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:48.487833 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Started (Lifecycle Event)
May 13 04:21:48.494576 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:48.500436 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.50.100,3260]
May 13 04:21:48.500436 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.50.100,3260] successful.
May 13 04:21:48.500436 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.503260 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance spawned successfully.
May 13 04:21:48.505138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.507341 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:48.509461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:48.509898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:48.514929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:48.518869 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.528352 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.528761 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:48.529065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:48.529065 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:48.535549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] HCTL ('10', '-', '-', 0) found on session 111 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:48.535549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.542656 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:48.542950 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:48.543134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:48.543134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:48.544028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] HCTL ('15', '-', '-', 0) found on session 112 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:48.544452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:48.553572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Searching for a device in session 111 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:48.553673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:48.567998 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Searching for a device in session 112 and hctl ['15', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:48.863506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:48.863635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:48.863892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:48.864053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:48.864203 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:48.869733 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Terminating instance
May 13 04:21:48.996607 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:48.999344 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:49.022249 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.022249 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.022761 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.023261 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.024454 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.026206 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:49.374038 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:21:49.403055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.408812 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.446598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.453208 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.481962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.485180 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.502891 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:49.503139 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646109.5029314, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:49.503301 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Paused (Lifecycle Event)
May 13 04:21:49.539291 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Took 7.87 seconds to spawn the instance on the hypervisor.
May 13 04:21:49.539291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:49.551838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:49.568499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Searching for a device in session 112 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:49.568674 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:49.717384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received unexpected event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with vm_state active and task_state None.
May 13 04:21:49.719493 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:49.720167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:49.721030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:49.721197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:49.721261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] No waiting events found dispatching network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:49.721449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2952123-4f6c-4806-8a6b-79fb5bb426cd req-ca0a3c99-a53c-49e5-983f-aa03536ffdfc service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:49.730501 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Instance destroyed successfully.
May 13 04:21:49.732773 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'resources' on Instance uuid d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:49.757527 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:50.008015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:50.011978 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646110.0111036, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:50.011978 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Resumed (Lifecycle Event)
May 13 04:21:50.054478 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Took 13.70 seconds to build instance.
May 13 04:21:50.233938 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-716242465',display_name='tempest-TestEncryptedCinderVolumes-server-716242465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-716242465',id=46,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwHBrU7GBrfDzxXRV4GSjIWVKT102okTHG/7IwWErC5mq1BlQJX06obsIt8PwaSEoEWYUaMOWrbGgz5sslJqdrJ+4Bvpe9GvILiC+SVC/ZHZtusUriyzed60IDFZjhk7Q==',key_name='tempest-keypair-2129601127',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:53Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-914x6r5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=d071d2d8-dde9-47d3-97ea-6cee2c5b72d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:21:50.234167 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "a139b326-ade2-4f32-bea5-e75219028adc", "address": "fa:16:3e:35:d0:2f", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa139b326-ad", "ovs_interfaceid": "a139b326-ade2-4f32-bea5-e75219028adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:50.235079 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:50.235461 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:21:50.237667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:50.237759 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa139b326-ad, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:50.238915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:50.240678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:50.240678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:50.240809 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6553405f-47f3-41f3-9d67-2ebb45b80f3a) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:50.241290 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:50.241867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:50.243435 np0000000669 nova-compute[97951]: INFO os_vif [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:d0:2f,bridge_name='br-int',has_traffic_filtering=True,id=a139b326-ade2-4f32-bea5-e75219028adc,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa139b326-ad')
May 13 04:21:50.243687 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Deleting instance files /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8_del
May 13 04:21:50.244406 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Deletion of /opt/stack/data/nova/instances/d071d2d8-dde9-47d3-97ea-6cee2c5b72d8_del complete
May 13 04:21:50.328048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Found WWN 330000000e88a25a6 for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:50.328369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:50.328578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000e88a25a6', 'path': '/dev/dm-3', 'multipath_id': '330000000e88a25a6'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:50.328741 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e88a25a6', 'path': '/dev/dm-3', 'multipath_id': '330000000e88a25a6'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:50.329656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.820s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:50.329936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:50.332227 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lazy-loading 'flavor' on Instance uuid 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:50.346794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:50.346794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:50.346794 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:50.350281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:50.350281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:50.350281 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:50.360611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:50.360611 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:50.369084 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:50.369084 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:50.382512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0] added
May 13 04:21:50.382512 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:50.382512 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:50.382512 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:50.382512 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:50.382512 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:50.382512 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:50.383508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:50.386214 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:50.386583 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:50.387670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0] added
May 13 04:21:50.387670 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:50.387670 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:50.387670 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:50.387670 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:50.387670 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:50.387670 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:50.387887 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:50.388109 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:50.388277 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:50.513795 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:50.516694 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:50.556154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.207s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:50.754902 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 04:21:50.756240 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:21:50.756472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:21:50.756574 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:21:50.757815 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:50.837007 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Attempting to attach volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:21:50.841853 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:   <alias name="ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d"/>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:   <serial>58128c2e-b6f5-4ae5-aeca-99a88d75940d</serial>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:50.841853 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:21:50.845779 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:51.020289 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99975104699979 future=<Future at 0x7a463c0ed040 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:51.387584 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:51.392342 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:51.405620 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:51.405620 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:51.413880 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:51.413880 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.438294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.440807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.466342 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.472564 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.472877 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:51.503972 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c090b2ae-1e8d-4e78-8f94-9f469a84c88a req-6b64d3cc-242e-4944-8f33-927c03ea34b8 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-deleted-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:51.504171 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c090b2ae-1e8d-4e78-8f94-9f469a84c88a req-6b64d3cc-242e-4944-8f33-927c03ea34b8 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Neutron deleted interface a139b326-ade2-4f32-bea5-e75219028adc; detaching it from the instance and deleting it from the info cache
May 13 04:21:51.504242 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c090b2ae-1e8d-4e78-8f94-9f469a84c88a req-6b64d3cc-242e-4944-8f33-927c03ea34b8 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:51.511347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260]
May 13 04:21:51.511347 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260] successful.
May 13 04:21:51.511347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.535313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.541978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260]
May 13 04:21:51.541978 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260] successful.
May 13 04:21:51.541978 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.560467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.564911 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.565271 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:51.565569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:51.565569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:51.566467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] HCTL ('16', '-', '-', 0) found on session 113 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:51.566565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.586409 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:51.586842 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:51.587238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.239s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:51.587238 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:51.588099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] HCTL ('17', '-', '-', 0) found on session 114 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:51.588227 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:51.597406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 113 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:51.597406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:51.620053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 114 and hctl ['17', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:51.762367 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005283860000417917 future=<Future at 0x7a463c7a1280 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:51.763373 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:51.763373 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.257065990999763 future=<Future at 0x7a463c0ed040 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:51.763373 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.256957278999835 future=<Future at 0x7a463c0ed040 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:21:51.768342 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646096.7616465, fd379e34-a21d-45c7-99e6-6f77272bc1ce => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:51.768342 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] VM Stopped (Lifecycle Event)
May 13 04:21:51.771829 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:51.860843 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:51.860843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] Acquiring lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:51.860843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:51.860843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:51.861192 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] No waiting events found dispatching network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:51.861312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-92a2785d-51dc-4d96-b842-1839c5664ccf req-fc0dfb93-52aa-4eb5-abcb-a3b09ff97d25 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Received event network-vif-unplugged-a139b326-ade2-4f32-bea5-e75219028adc for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:21:52.008399 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c090b2ae-1e8d-4e78-8f94-9f469a84c88a req-6b64d3cc-242e-4944-8f33-927c03ea34b8 service nova] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Detach interface failed, port_id=a139b326-ade2-4f32-bea5-e75219028adc, reason: Instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:21:52.268679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: fd379e34-a21d-45c7-99e6-6f77272bc1ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:52.276806 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Took 1.52 seconds to deallocate network for instance.
May 13 04:21:52.537494 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:52.537950 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:52.537950 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:52.537950 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] No VIF found with MAC fa:16:3e:d2:6c:4a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:52.567267 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:52.622046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 114 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:52.622046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:52.784644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:52.784793 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:53.366778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Found WWN 3300000001288eeaa for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:21:53.367080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:53.367219 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== connect_volume: return (4857ms) {'type': 'block', 'scsi_wwn': '3300000001288eeaa', 'path': '/dev/dm-4', 'multipath_id': '3300000001288eeaa'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:53.367362 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001288eeaa', 'path': '/dev/dm-4', 'multipath_id': '3300000001288eeaa'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:21:53.444184 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:21:53.444493 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:21:53.813654 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:53.815371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:53.888607 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7nAvRnQj9V+BRBsiL8wNdE+Q7/iisL31osE7FWHwcXXz6yD+do17RY1dKHTC32CIpRr241qaXyv9AlFU4UugAxUowd+86kbE0PVrvZM9luOAjm3SsVe3FP7NKdLQd+dw==',key_name='tempest-TestShelveInstance-1344705829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:45Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:21:53.888845 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:53.889402 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:53.890397 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'pci_devices' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:53.948479 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:21:53.964515 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:53.964636 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing instance network info cache due to event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:53.964786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:53.964929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:53.965015 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:54.119726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6884af47-9af7-4978-a255-a9b7063661fd tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.573s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:54.189778 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event volume-extended-58128c2e-b6f5-4ae5-aeca-99a88d75940d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:54.322944 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:21:54.394036 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] End _get_guest_xml xml=<domain type="qemu">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <uuid>e44483e5-9065-40b6-a4ea-12eb9109fea5</uuid>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <name>instance-00000033</name>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestShelveInstance-server-683657741</nova:name>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:21:48</nova:creationTime>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:user uuid="f50ff3fb0b4c41dea9c79fe8d54cf794">tempest-TestShelveInstance-592071318-project-member</nova:user>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:project uuid="7e642c6f91a844b89aaaca335f536052">tempest-TestShelveInstance-592071318</nova:project>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         <nova:port uuid="c8d889b7-1f3e-4898-9838-0d40c92de7f5">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <system>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="serial">e44483e5-9065-40b6-a4ea-12eb9109fea5</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="uuid">e44483e5-9065-40b6-a4ea-12eb9109fea5</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </system>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <os>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </os>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <features>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </features>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   <devices>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <alias name="ua-f8925d06-5a4a-4aea-9692-34140d6314a0"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-4"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <serial>f8925d06-5a4a-4aea-9692-34140d6314a0</serial>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </disk>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:6d:b8:76"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <target dev="tapc8d889b7-1f"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </interface>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/console.log" append="off"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </serial>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <video>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </video>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </rng>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:   </devices>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]: </domain>
May 13 04:21:54.394036 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Preparing to wait for external event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7nAvRnQj9V+BRBsiL8wNdE+Q7/iisL31osE7FWHwcXXz6yD+do17RY1dKHTC32CIpRr241qaXyv9AlFU4UugAxUowd+86kbE0PVrvZM9luOAjm3SsVe3FP7NKdLQd+dw==',key_name='tempest-TestShelveInstance-1344705829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:21:45Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:21:54.397717 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:21:54.399359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.399359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:54.399359 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:21:54.400676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.400676 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec0b37e5-05cc-5173-80d1-ee2402bebe83', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:54.401785 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.401785 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:54.404292 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.408176 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.409585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8d889b7-1f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:54.409585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8d889b7-1f, col_values=(('qos', UUID('8dd94b58-8d0f-4acb-8e90-9c69f6a2d974')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:54.409585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8d889b7-1f, col_values=(('external_ids', {'iface-id': 'c8d889b7-1f3e-4898-9838-0d40c92de7f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b8:76', 'vm-uuid': 'e44483e5-9065-40b6-a4ea-12eb9109fea5'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:21:54.410024 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.412946 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:21:54.417212 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.418312 np0000000669 nova-compute[97951]: INFO os_vif [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f')
May 13 04:21:54.460632 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.671s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:54.467778 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:54.554245 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deleted allocations for instance d071d2d8-dde9-47d3-97ea-6cee2c5b72d8
May 13 04:21:54.692932 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Handling volume-extended event for volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d {{(pid=97951) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 13 04:21:54.830021 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:54.971250 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:55.189703 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updated VIF entry in instance network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:55.190145 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:55.196271 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Cinder extended volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d; extending it to detect new size
May 13 04:21:55.334597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:55.563867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0c9bc70a-61ec-4a8a-ae1c-024d22223786 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d071d2d8-dde9-47d3-97ea-6cee2c5b72d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.700s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:55.692720 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:55.693503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:55.693503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing instance network info cache due to event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:21:55.693503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:21:55.693503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:21:55.693684 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:21:55.749417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] calling os-brick to extend iSCSI Volume {{(pid=97951) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 13 04:21:55.750478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}), 'kwargs': {}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:55.750478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:55.750478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:55.751504 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}
May 13 04:21:55.751504 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Multipath discovery for iSCSI enabled
May 13 04:21:55.751504 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0']
May 13 04:21:55.751504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0'] {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 13 04:21:55.787779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0'] {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 13 04:21:55.788069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Running cmd (subprocess): lsscsi {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:55.864181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] CMD "lsscsi" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:55.865646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97951) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 13 04:21:55.866528 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 13 04:21:55.879655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Starting size: 1073741824 {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 13 04:21:55.935077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] volume size after scsi device rescan 2147483648 {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 13 04:21:55.935077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Running cmd (subprocess): lsscsi {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:55.981807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:55.982298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:21:55.982298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No VIF found with MAC fa:16:3e:6d:b8:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:21:55.986564 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Using config drive
May 13 04:21:55.992178 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] CMD "lsscsi" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:55.992539 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', 'host': '15', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97951) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 13 04:21:55.992904 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d-lun-0', 'host': '15', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 13 04:21:56.008770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Starting size: 1073741824 {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 13 04:21:56.046204 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] volume size after scsi device rescan 2147483648 {{(pid=97951) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 13 04:21:56.062450 np0000000669 nova-compute[97951]: INFO os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Find Multipath device file for volume WWN 330000000e88a25a6
May 13 04:21:56.064871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000e88a25a6 exists yet. {{(pid=97951) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 13 04:21:56.064871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] /dev/disk/by-id/dm-uuid-mpath-330000000e88a25a6 has shown up. {{(pid=97951) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 13 04:21:56.102294 np0000000669 nova-compute[97951]: INFO os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000e88a25a6) current size 1073741824
May 13 04:21:56.179151 np0000000669 nova-compute[97951]: INFO os_brick.initiator.linuxscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000e88a25a6) new size 2147483648
May 13 04:21:56.179547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.429s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:56.179764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] <== extend_volume: return (430ms) 2147483648 {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:56.179991 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Extend iSCSI Volume: new_size=2147483648 {{(pid=97951) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 13 04:21:56.192359 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [req-204ace6a-8f50-472f-af14-5b6b25dfd858 req-48cee88f-cc12-4d47-a5ed-b0f664cd1758 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Resizing target device /dev/dm-3 to 2147483648 {{(pid=97951) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 13 04:21:56.196362 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:56.477637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:56.477788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:56.478082 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attaching volume 47665bd1-526c-4195-a0e3-3a9059be3304 to /dev/vdb
May 13 04:21:56.498888 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:56.565762 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:56.582858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:21:56.619006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:56.688702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:21:56.695251 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:21:56.715762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:21:56.717050 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fed2:6c4a', 'fe80::24aa:daff:fec0:df91', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe65:3527', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe08:ed36'] 
May 13 04:21:56.717164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:21:56.717217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:21:56.717545 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:21:56.717757 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating existing volume attachment record: e031cfce-2afd-4558-99b2-3b1e8aae81d4 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:21:56.813880 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating config drive at /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config
May 13 04:21:56.822087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19sp2e76 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:21:56.899069 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:21:56.902366 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19sp2e76" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:21:57.083645 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updated VIF entry in instance network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:21:57.083645 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:21:57.280545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:57.281403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:57.323987 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:21:57.324726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:21:57.324726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:57.325122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:57.325381 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:21:57.340294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:57.341236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:21:57.342163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:57.342682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:21:57.343874 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:57.344033 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:57.360356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:57.360356 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:57.365408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:21:57.365408 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:57.378409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304] added
May 13 04:21:57.378409 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:57.378409 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:57.378409 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:57.378409 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:57.378409 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:57.378409 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:57.379625 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:57.379948 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:57.380392 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:57.381968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304] added
May 13 04:21:57.381968 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:21:57.381968 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:57.381968 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:57.381968 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:21:57.381968 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:21:57.381968 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:57.382198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:21:57.382488 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:21:57.382679 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:21:57.403740 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.438877 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.532702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.588310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5911d772-6730-4f82-8f88-c60a5e4a16c0 req-736e01b9-f4ad-4700-ad22-1e65d70189d7 service nova] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:21:57.638091 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cf38017-ed82-438d-a971-d96abeb3f08f req-048f54e1-dcb0-4aa8-84ed-4ea96fd51fd7 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:57.638091 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cf38017-ed82-438d-a971-d96abeb3f08f req-048f54e1-dcb0-4aa8-84ed-4ea96fd51fd7 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:57.638152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cf38017-ed82-438d-a971-d96abeb3f08f req-048f54e1-dcb0-4aa8-84ed-4ea96fd51fd7 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:57.638294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cf38017-ed82-438d-a971-d96abeb3f08f req-048f54e1-dcb0-4aa8-84ed-4ea96fd51fd7 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:57.638450 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cf38017-ed82-438d-a971-d96abeb3f08f req-048f54e1-dcb0-4aa8-84ed-4ea96fd51fd7 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Processing event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:21:57.785975 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Detaching volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d
May 13 04:21:57.793660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.802411 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.826270 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:57.858561 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Attempting to driver detach volume 58128c2e-b6f5-4ae5-aeca-99a88d75940d from mountpoint /dev/vdb
May 13 04:21:57.877020 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Found disk vdb by alias ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:57.880302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Found disk vdb by alias ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:21:57.880793 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Attempting to detach device vdb from instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:21:57.880793 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <alias name="ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d"/>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <serial>58128c2e-b6f5-4ae5-aeca-99a88d75940d</serial>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:57.880793 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:57.903370 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Successfully detached device vdb from instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 from the persistent domain config.
May 13 04:21:57.903370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] (1/8): Attempting to detach device vdb with device alias ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d from instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:21:57.903370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <alias name="ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d"/>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <serial>58128c2e-b6f5-4ae5-aeca-99a88d75940d</serial>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]: </disk>
May 13 04:21:57.903370 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:21:58.380802 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:21:58.383232 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:58.397887 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:58.397887 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:21:58.406753 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:21:58.406753 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.416096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.421356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.446906 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.449362 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.449762 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.453077 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:58.518907 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.40.100,3260]
May 13 04:21:58.518907 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.40.100,3260] successful.
May 13 04:21:58.518907 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.525748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.50.100,3260]
May 13 04:21:58.525748 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.50.100,3260] successful.
May 13 04:21:58.525748 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.536034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.545348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.578581 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.579124 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:58.579124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:58.580393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('18', '-', '-', 0) found on session 115 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:58.580503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.589298 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-900fb0f5-37c4-4089-a283-04a1203ff4fb (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:21:58.589968 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:21:58.590743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.249s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:21:58.591555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:21:58.597651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('19', '-', '-', 0) found on session 116 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:21:58.597899 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:21:58.617091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 115 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:58.617300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:58.626184 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 116 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:21:58.626184 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:21:58.642460 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:21:58.644315 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646118.643489, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:58.644315 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Started (Lifecycle Event)
May 13 04:21:58.648608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:21:58.657777 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance spawned successfully.
May 13 04:21:58.659365 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:21:58.669063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d for instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:21:59.149264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:59.154710 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:21:59.173476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.173476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.173476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.173476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.174378 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.175276 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:21:59.342175 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:21:59.410770 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:21:59.658554 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:21:59.658698 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646119.6584232, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:21:59.659072 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Paused (Lifecycle Event)
May 13 04:21:59.681751 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Took 11.67 seconds to spawn the instance on the hypervisor.
May 13 04:21:59.682148 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:21:59.741914 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-39d0def7-529b-488c-9554-d235d9ad6c5d req-89019e24-badf-4b9a-87d5-4083ae53d9a1 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received unexpected event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with vm_state building and task_state spawning.
May 13 04:21:59.830598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:00.161213 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:00.165650 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646120.164034, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:00.165650 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Resumed (Lifecycle Event)
May 13 04:22:00.195081 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Took 19.29 seconds to build instance.
May 13 04:22:00.368182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000caa612da for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:22:00.368182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:00.368182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:00.368182 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:22:00.369842 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:00.429059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:00.668589 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:00.672869 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:00.699506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-34233338-7f1a-4b94-8c74-1712a8611fca tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.810s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:00.872686 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attempting to attach volume 47665bd1-526c-4195-a0e3-3a9059be3304 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:22:00.874519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]: </disk>
May 13 04:22:00.874519 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:22:01.178048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646121.1776397, 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 => ua-58128c2e-b6f5-4ae5-aeca-99a88d75940d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:22:01.188530 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Successfully detached device vdb from instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 from the live domain config.
May 13 04:22:01.193756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:01.196399 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:01.198240 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:22:01.199143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:01.200929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:01.202226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:01.202226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58128c2e-b6f5-4ae5-aeca-99a88d75940d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:22:01.202226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:01.244352 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', '111')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d', '112')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:01.244352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c116020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:22:01.246584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Removing multipathed devices sdj, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:22:01.246999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Flush multipath device 330000000e88a25a6 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:22:01.286363 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:01.339992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:01.387157 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Checking to see if SCSI volumes sdj, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:22:01.391407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] SCSI volumes sdj, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:22:01.392796 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Checking to see if device paths {'sdj', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:22:01.408946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Device paths {'sdj', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:22:01.408946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:22:01.429685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.479830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.40.100,3260]
May 13 04:22:01.479830 np0000000669 nova-compute[97951]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.40.100,3260] successful.
May 13 04:22:01.479830 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.506437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.523917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.563079 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.50.100,3260]
May 13 04:22:01.563079 np0000000669 nova-compute[97951]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-58128c2e-b6f5-4ae5-aeca-99a88d75940d, portal: 192.168.50.100,3260] successful.
May 13 04:22:01.563079 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.588176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:01.588423 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:01.588581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] <== disconnect_volume: return (387ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:01.588750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:22:01.700027 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:22:02.155778 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lazy-loading 'flavor' on Instance uuid 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:02.282712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:02.283096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:02.286105 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:02.286227 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Claim successful on node np0000000669
May 13 04:22:02.587427 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:02.589924 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:02.589924 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:02.589924 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:9e:60:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:22:03.061899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:03.061899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing instance network info cache due to event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:03.062052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:03.062110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:03.062446 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:03.165981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a56f861a-9b0c-4e44-a01f-d14c0fd5166c tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.885s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:03.564397 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:03.576511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:03.721183 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:03.721454 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:03.721661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:03.721819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:03.721942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:03.725640 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Terminating instance
May 13 04:22:03.859619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:03.859912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:03.906129 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:03.906403 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:04.017709 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:04.153890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-801eec82-9acf-4648-9454-cd8785d3cd3a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.676s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:04.199190 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updated VIF entry in instance network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:04.200064 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:04.234124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:22:04.260178 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.294686 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.309922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.340933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.364000 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:04.409389 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:04.415420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.544343 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.556211 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.575892 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999606557999869 future=<Future at 0x7a463c0ffa70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:04.578238 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Instance destroyed successfully.
May 13 04:22:04.578947 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lazy-loading 'resources' on Instance uuid 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:04.704659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f2fdcd1b-2dfc-4bb1-a8a6-addc8a5e0c16 req-7e550a37-8513-4bb6-a363-d60a2c67cc5b service nova] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:04.831733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:04.918833 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.635s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:04.918898 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:22:05.082550 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-150189682',display_name='tempest-VolumesExtendAttachedTest-instance-150189682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesextendattachedtest-instance-150189682',id=47,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbKoUQmqoxcbDNBgWG6YRLoPOxFoLgRSDIXFMqCZH56zgXduiaWW3aGqdai+o4Zsezxx5Ad+6y2JqmLzteTBaKe1y9I6V0AGX9zpKJF7yHcP58MJK0VpqhdIuH28ujOQ==',key_name='tempest-keypair-137503066',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:05Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65a23aa4db5e48eeadf67eec77fd305c',ramdisk_id='',reservation_id='r-x1wh7s9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-518230319',owner_user_name='tempest-VolumesExtendAttachedTest-518230319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d175545dbc2641f88c4b0041e3d00f21',uuid=6a3bb372-804d-4ddd-a8fa-03591cf3f5c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:22:05.082762 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converting VIF {"id": "4132b554-e91f-410f-b57a-a50a5aee59a8", "address": "fa:16:3e:d2:6c:4a", "network": {"id": "c945174a-a554-4d3d-9cb3-2d86eaceaedf", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-747646254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "65a23aa4db5e48eeadf67eec77fd305c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4132b554-e9", "ovs_interfaceid": "4132b554-e91f-410f-b57a-a50a5aee59a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:05.083457 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:05.083712 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:22:05.085532 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:05.085715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4132b554-e9, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:05.088210 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:05.090441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:05.091100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:05.091252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f020926c-b851-4047-8c54-19f94be08255) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:05.091755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:05.092310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:05.094311 np0000000669 nova-compute[97951]: INFO os_vif [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6c:4a,bridge_name='br-int',has_traffic_filtering=True,id=4132b554-e91f-410f-b57a-a50a5aee59a8,network=Network(c945174a-a554-4d3d-9cb3-2d86eaceaedf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4132b554-e9')
May 13 04:22:05.094600 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Deleting instance files /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0_del
May 13 04:22:05.098399 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Deletion of /opt/stack/data/nova/instances/6a3bb372-804d-4ddd-a8fa-03591cf3f5c0_del complete
May 13 04:22:05.369993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:05.425607 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:22:05.426731 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:22:05.426731 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:05.426731 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:05.545061 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '434adac2000c4da29488decad2034361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e227d582564c4ef7b5ab8d19583df520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:22:05.603922 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 04:22:05.604355 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:22:05.604496 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:22:05.604598 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:22:05.604918 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:05.725335 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:05.929058 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:22:06.020497 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00044737000007444294 future=<Future at 0x7a463c0ed040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:06.022803 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:06.022803 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.553765015999943 future=<Future at 0x7a463c0ffa70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:06.022803 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.55366948899973 future=<Future at 0x7a463c0ffa70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:06.022803 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778646111.0199475, d071d2d8-dde9-47d3-97ea-6cee2c5b72d8 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:06.022803 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] VM Stopped (Lifecycle Event)
May 13 04:22:06.176150 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Successfully created port: 0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:22:06.432939 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:22:06.469153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:06.471285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:06.471285 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attaching volume 47665bd1-526c-4195-a0e3-3a9059be3304 to /dev/vdb
May 13 04:22:06.525696 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: d071d2d8-dde9-47d3-97ea-6cee2c5b72d8] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:06.569666 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:06.586372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:22:06.623952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:06.682824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:22:06.684285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:22:06.700308 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dffe5301-df6d-4ccc-ab75-58fe34e6af09 req-4bb3e38f-9ad9-4da2-ac38-5e24f88340b1 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Received event network-vif-deleted-4132b554-e91f-410f-b57a-a50a5aee59a8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:06.700506 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-dffe5301-df6d-4ccc-ab75-58fe34e6af09 req-4bb3e38f-9ad9-4da2-ac38-5e24f88340b1 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Neutron deleted interface 4132b554-e91f-410f-b57a-a50a5aee59a8; detaching it from the instance and deleting it from the info cache
May 13 04:22:06.700687 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-dffe5301-df6d-4ccc-ab75-58fe34e6af09 req-4bb3e38f-9ad9-4da2-ac38-5e24f88340b1 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:06.709144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:22:06.714046 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe65:3527', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe6d:b876', 'fe80::209c:c2ff:fe09:82a1'] 
May 13 04:22:06.714046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:22:06.714046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:22:06.714391 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:06.714732 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating existing volume attachment record: 85abff7c-0276-4b31-88d4-28ed876d760e {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:22:06.866062 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:07.023187 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Successfully updated port: 0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:22:07.097410 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-changed-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:07.097614 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Refreshing instance network info cache due to event network-changed-0607dcc9-c07a-477c-9a1e-1e3875e914d3. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:07.099242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] Acquiring lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:07.099371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] Acquired lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:07.099514 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Refreshing network info cache for port 0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:07.131724 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:07.222542 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dffe5301-df6d-4ccc-ab75-58fe34e6af09 req-4bb3e38f-9ad9-4da2-ac38-5e24f88340b1 service nova] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Detach interface failed, port_id=4132b554-e91f-410f-b57a-a50a5aee59a8, reason: Instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:22:07.303466 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:22:07.303647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:07.303812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:07.304396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:07.304724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:22:07.324115 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:07.325023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:07.325513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:07.326130 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:07.326884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:07.327640 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:07.352576 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:07.352576 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:07.367622 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:07.367622 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:07.375711 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Took 1.77 seconds to deallocate network for instance.
May 13 04:22:07.381927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:07.395164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-548502f4-fd4e-4957-bc5f-30b60afbe24c (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.407402 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-548502f4-fd4e-4957-bc5f-30b60afbe24c (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.407902 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:07.408628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.081s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:07.408628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:07.409059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('19', '0', '0', 0) found on session 116 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:07.411788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:07.423552 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 116 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:07.423887 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-548502f4-fd4e-4957-bc5f-30b60afbe24c (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.424695 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-548502f4-fd4e-4957-bc5f-30b60afbe24c (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:07.425281 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:07.425829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.100s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:07.425829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:07.426400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('18', '0', '0', 0) found on session 115 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:07.426950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:07.443669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 115 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:07.443669 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:07.449194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:22:07.450855 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:22:07.452824 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Creating image(s)
May 13 04:22:07.453442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:07.453916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:07.459166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:07.460516 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:22:07.467161 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:22:07.467161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:07.528540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:07.599923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:07.600864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:07.601416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:07.602123 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:22:07.603147 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:07.613395 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:22:07.622025 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:07.751471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:07.754280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:07.774890 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:22:07.838962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk 1073741824" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:07.842836 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:07.844123 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:07.891392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:07.892066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:07.984424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.141s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:07.986467 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:22:07.988389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:08.159100 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:08.174056 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Cannot resize image /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Ensure instance console log exists: /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:08.177365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:08.326963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:22:08.670810 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f97b7824-40ab-43d3-93f5-69da36ea33a2 req-65c6cc46-5e31-45b8-93b2-b18ee9b1914a service nova] Releasing lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:08.671933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquired lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:08.671933 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:08.727787 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:08.728488 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:09.233148 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:09.268723 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:22:09.350833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000caa612da for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:22:09.350833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.045s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:09.350833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:09.350833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:22:09.357873 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:09.513343 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:09.749274 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updating instance_info_cache with network_info: [{"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:09.753253 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:09.758747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.857s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:09.835827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:09.864263 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attempting to attach volume 47665bd1-526c-4195-a0e3-3a9059be3304 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:22:09.873453 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]: </disk>
May 13 04:22:09.873453 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:22:09.883862 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Deleted allocations for instance 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0
May 13 04:22:10.092739 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.254377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Releasing lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:10.254814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance network_info: |[{"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:22:10.259174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Start _get_guest_xml network_info=[{"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:22:10.263540 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:22:10.264670 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1640093144', uuid='76650676-a82a-4545-8a20-9a44c8ac7419'), owner=OwnerMeta(userid='434adac2000c4da29488decad2034361', username='tempest-TestEncryptedCinderVolumes-280722860-project-member', projectid='e227d582564c4ef7b5ab8d19583df520', projectname='tempest-TestEncryptedCinderVolumes-280722860'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646130.264261) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:22:10.266832 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:22:10.266832 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:22:10.273294 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:22:10.273587 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:22:10.274875 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:22:10.275272 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:22:10.275548 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:22:10.275662 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:22:10.275832 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:22:10.275969 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:22:10.276117 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:22:10.276312 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:22:10.276509 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:22:10.276665 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:22:10.276819 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:22:10.276977 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:22:10.296157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1640093144',display_name='tempest-TestEncryptedCinderVolumes-server-1640093144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1640093144',id=52,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAp8p6ZFEb/m8qd8eIHXcPdPE0mAv32LNoTee4BEZx9tQqfgV8mUfOU62i+/kI1/avSYUjTml2GnikRUw2SYKtiKrWHC846rc4iLt0eCE4dah31w/J8dFBTgzFaE6xu+g==',key_name='tempest-keypair-1758183129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-zyu7n8km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=76650676-a82a-4545-8a20-9a44c8ac7419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:22:10.296157 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:10.298364 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:10.299974 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'pci_devices' on Instance uuid 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:10.807856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] End _get_guest_xml xml=<domain type="qemu">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <uuid>76650676-a82a-4545-8a20-9a44c8ac7419</uuid>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <name>instance-00000034</name>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1640093144</nova:name>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:22:10</nova:creationTime>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:user uuid="434adac2000c4da29488decad2034361">tempest-TestEncryptedCinderVolumes-280722860-project-member</nova:user>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:project uuid="e227d582564c4ef7b5ab8d19583df520">tempest-TestEncryptedCinderVolumes-280722860</nova:project>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         <nova:port uuid="0607dcc9-c07a-477c-9a1e-1e3875e914d3">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <system>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="serial">76650676-a82a-4545-8a20-9a44c8ac7419</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="uuid">76650676-a82a-4545-8a20-9a44c8ac7419</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </system>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <os>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </os>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <features>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </features>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   <devices>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.config"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:95:05:7a"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <target dev="tap0607dcc9-c0"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </interface>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/console.log" append="off"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </serial>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <video>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </video>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </rng>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:   </devices>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]: </domain>
May 13 04:22:10.807856 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Preparing to wait for external event network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1640093144',display_name='tempest-TestEncryptedCinderVolumes-server-1640093144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1640093144',id=52,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAp8p6ZFEb/m8qd8eIHXcPdPE0mAv32LNoTee4BEZx9tQqfgV8mUfOU62i+/kI1/avSYUjTml2GnikRUw2SYKtiKrWHC846rc4iLt0eCE4dah31w/J8dFBTgzFaE6xu+g==',key_name='tempest-keypair-1758183129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-zyu7n8km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=76650676-a82a-4545-8a20-9a44c8ac7419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:10.813338 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:22:10.815826 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.816416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97acbc36-79e6-5581-a7fd-650c129f2c5e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:10.820364 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.821506 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:10.824611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.825028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0607dcc9-c0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:10.825271 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0607dcc9-c0, col_values=(('qos', UUID('6d200c9f-013b-422a-a08b-2826163630ba')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:10.825570 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0607dcc9-c0, col_values=(('external_ids', {'iface-id': '0607dcc9-c07a-477c-9a1e-1e3875e914d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:05:7a', 'vm-uuid': '76650676-a82a-4545-8a20-9a44c8ac7419'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:10.826947 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.828777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:10.837541 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:10.839029 np0000000669 nova-compute[97951]: INFO os_vif [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0')
May 13 04:22:10.905676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5ec38160-f22d-473d-979a-646e4429c3b5 tempest-VolumesExtendAttachedTest-518230319 tempest-VolumesExtendAttachedTest-518230319-project-member] Lock "6a3bb372-804d-4ddd-a8fa-03591cf3f5c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.184s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:11.609668 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:11.610010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:11.610010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:11.610010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:08:ed:36, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:22:12.364530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:12.364667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:12.364825 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:95:05:7a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:22:12.365288 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Using config drive
May 13 04:22:12.871687 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:13.064060 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Creating config drive at /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.config
May 13 04:22:13.069301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpchld384g {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:13.143892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpchld384g" returned: 0 in 0.074s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:13.197357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0eb3cf8d-db88-4654-9674-34b1a9555867 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.727s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:13.628598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:13.662105 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:13.664647 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:13.767256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:13.940099 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6105c172-c706-41e1-a15c-0a7b26606520 req-080b737e-6a89-4cdd-bd7d-78af09355e83 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:13.941561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6105c172-c706-41e1-a15c-0a7b26606520 req-080b737e-6a89-4cdd-bd7d-78af09355e83 service nova] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:13.941850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6105c172-c706-41e1-a15c-0a7b26606520 req-080b737e-6a89-4cdd-bd7d-78af09355e83 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:13.942061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6105c172-c706-41e1-a15c-0a7b26606520 req-080b737e-6a89-4cdd-bd7d-78af09355e83 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:13.943505 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6105c172-c706-41e1-a15c-0a7b26606520 req-080b737e-6a89-4cdd-bd7d-78af09355e83 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Processing event network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:22:14.036667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:14.048795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:14.076282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:14.681137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:22:14.681137 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646134.6806824, 76650676-a82a-4545-8a20-9a44c8ac7419 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:14.681137 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] VM Started (Lifecycle Event)
May 13 04:22:14.686567 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:22:14.689109 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance spawned successfully.
May 13 04:22:14.689615 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:22:14.836933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:15.184264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:15.186892 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:15.203237 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.203640 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.206343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.206343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.206343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.206343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:15.383772 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Stashing vm_state: active {{(pid=97951) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 04:22:15.474209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:15.691746 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:22:15.692257 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646135.6918912, 76650676-a82a-4545-8a20-9a44c8ac7419 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:15.692257 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] VM Paused (Lifecycle Event)
May 13 04:22:15.722683 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Took 8.27 seconds to spawn the instance on the hypervisor.
May 13 04:22:15.722925 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:15.828081 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:15.977801 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:15.978100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:16.023550 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:16.023714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:16.023893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:16.024007 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:16.024119 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] No waiting events found dispatching network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:16.024231 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2b02df11-aad6-4438-8d5f-32b5456105b2 req-6d3469ba-4c4e-4cd0-bcce-afffe80d30aa service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received unexpected event network-vif-plugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 for instance with vm_state active and task_state None.
May 13 04:22:16.195442 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:16.201356 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646136.2001798, 76650676-a82a-4545-8a20-9a44c8ac7419 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:16.201356 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] VM Resumed (Lifecycle Event)
May 13 04:22:16.237548 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Took 14.03 seconds to build instance.
May 13 04:22:16.485004 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:16.485004 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Claim successful on node np0000000669
May 13 04:22:16.703305 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:16.709305 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:16.739256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.544s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:16.992135 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating resource usage from migration 998a8513-ae4f-42dc-b889-01d52f89309d
May 13 04:22:17.719606 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:17.719999 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:17.780374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:18.103375 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-changed-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:18.103592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Refreshing instance network info cache due to event network-changed-0607dcc9-c07a-477c-9a1e-1e3875e914d3. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:18.103849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] Acquiring lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:18.103982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] Acquired lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:18.104722 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Refreshing network info cache for port 0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:18.225702 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:18.609489 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:18.736691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.759s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:18.737130 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Migrating
May 13 04:22:18.737312 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:22:19.126941 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:19.270135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:19.270135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:19.270354 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:19.323405 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updated VIF entry in instance network info cache for port 0607dcc9-c07a-477c-9a1e-1e3875e914d3. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:19.323771 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updating instance_info_cache with network_info: [{"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:19.575574 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004956410002705525 future=<Future at 0x7a463c0ffa70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:19.576198 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646124.5747392, 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:19.576485 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:19.578104 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] VM Stopped (Lifecycle Event)
May 13 04:22:19.773795 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:19.826251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cf4480ac-90ee-4902-b102-7396386af314 req-64491d61-652f-427a-bdee-15fbc21eda9c service nova] Releasing lock "refresh_cache-76650676-a82a-4545-8a20-9a44c8ac7419" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:19.841704 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:20.080367 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 6a3bb372-804d-4ddd-a8fa-03591cf3f5c0] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:20.152683 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:20.203878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:20.204711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:20.204711 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:20.206607 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97951) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 04:22:20.209605 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'flavor' on Instance uuid e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:20.380343 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:20.835749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:20.883223 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:21.250480 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.256786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.280347 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.284204 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.309527 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.317983 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:21.551505 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:21.551773 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:21.551981 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:21.552634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:21.552634 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] No waiting events found dispatching network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:21.552634 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-925f44cd-b84e-4df1-ae3d-b10e47cc8a18 req-d16966df-5f27-44f1-b563-45ea6cd3edeb service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received unexpected event network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee for instance with vm_state active and task_state powering-off.
May 13 04:22:21.662395 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99973078999983 future=<Future at 0x7a463c3420f0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:21.663634 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999381302000074 future=<Future at 0x7a463c3420f0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:21.665441 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998194057000092 future=<Future at 0x7a463c3420f0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:21.668412 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance destroyed successfully.
May 13 04:22:21.669126 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'numa_topology' on Instance uuid e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:22.171879 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:22:22.173469 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:22.399749 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Starting migrate_disk_and_power_off {{(pid=97951) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 04:22:22.434865 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.442659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.469434 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.633978 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.648911 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.697285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-a13570e9-8138-473f-9867-e35cbb3c4697 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.493s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:22.761007 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:22.761410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:22.761410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:22.762139 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:22.762139 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:22.762139 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-100b1ff8-bc20-403f-9af2-83d9133dbc99 req-2e3baacd-da29-4763-a47f-e41cf161f8a0 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received unexpected event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with vm_state active and task_state resize_migrating.
May 13 04:22:22.773360 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999745308000001 future=<Future at 0x7a461c7ad850 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:22.777129 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance destroyed successfully.
May 13 04:22:22.778027 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:30Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:22:22.779486 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:22.779950 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:22.780366 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:22:22.784567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.784841 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d23fe88-4c, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:22.786374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.788383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:22.796793 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.798539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.798753 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e127b29f-436d-43f7-95db-90b979a146c5) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:22.799301 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.799947 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:22.806913 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:22.809904 np0000000669 nova-compute[97951]: INFO os_vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c')
May 13 04:22:23.362067 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Detected multiple connections on this host for volume: 47665bd1-526c-4195-a0e3-3a9059be3304, skipping target disconnect.
May 13 04:22:23.365558 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:23.475741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:23.476876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:23.604441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:23.604441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:23.606778 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:23.653656 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:23.654779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:23.655092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:23.655591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:23.655777 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] No waiting events found dispatching network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:23.656156 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b7619f26-3409-46e2-b4e5-f872045cb491 req-194f59be-6912-4b06-a07d-636511915d2c service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received unexpected event network-vif-unplugged-246df767-9479-4cb6-abe2-7b5641bb9fee for instance with vm_state stopped and task_state None.
May 13 04:22:23.713044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:23.714468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk.config /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:23.808531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk.config /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:23.809167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk.info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:23.866478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_resize/disk.info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:24.085155 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:24.086435 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:24.613893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:24.615444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:24.615940 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:24.616142 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:22:24.843183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:24.901742 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:24.901742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:24.901742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:24.901742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:24.901742 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:24.901917 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-29ea0765-5eff-426e-9f7d-7118f4bbe61b req-cc29cfcf-27ee-44e5-a067-348dbd531b57 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received unexpected event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with vm_state active and task_state resize_migrating.
May 13 04:22:25.125502 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:25.125884 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:25.236182 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 binding to destination host np0000000669 is already ACTIVE {{(pid=97951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 04:22:25.681348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:25.683594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:25.803402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:25.803402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:25.901546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:25.901997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:25.907048 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.019518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.020422 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.139451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.144092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.254201 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:22:26.266308 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.270530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.306364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:26.306364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:26.306364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:26.379217 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.383205 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:26.388754 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:26.390504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.504941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.507603 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.613390 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.618824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.710557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.710946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.737514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:26.737678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:26.738041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:26.738223 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:26.738417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:26.745292 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Terminating instance
May 13 04:22:26.806615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.806615 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:26.812222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:26.906391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:26.906391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:27.027430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:27.027910 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:22:27.033190 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:22:27.034339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:27.086915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:27.087299 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=11434MB free_disk=72.88257217407227GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:22:27.087513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:27.087861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:27.252501 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:22:27.256491 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Instance destroyed successfully.
May 13 04:22:27.256491 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:27.311354 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:27.395557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:27.395557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:27.395557 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:27.765620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-353390139',display_name='tempest-TestVolumeBootPattern-server-353390139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-353390139',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzsMt94Lj51QX09kQIu7xDVBbvwheiJzIJ4GC1r+thNXd9P07d3800K1mRZDlY+WFrUkDXHNTxjta1zVTC3mur6AM9EZ393zHsWhKlt7xfJbRvMEmbIaCQ4NUJUGoPY9A==',key_name='tempest-keypair-1127217375',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:38Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-6qudncr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:22:27.766179 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "246df767-9479-4cb6-abe2-7b5641bb9fee", "address": "fa:16:3e:65:35:27", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap246df767-94", "ovs_interfaceid": "246df767-9479-4cb6-abe2-7b5641bb9fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:27.767175 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:27.769623 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:22:27.774143 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:27.774595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap246df767-94, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:27.777804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:27.786681 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:27.786996 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeeeb222-13ca-4fed-ae6f-fb8e3d16e6ff) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:27.787748 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:27.788881 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:27.789113 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:27.792895 np0000000669 nova-compute[97951]: INFO os_vif [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:35:27,bridge_name='br-int',has_traffic_filtering=True,id=246df767-9479-4cb6-abe2-7b5641bb9fee,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246df767-94')
May 13 04:22:27.798584 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:22:27.799022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:27.799178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:27.799447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:27.799751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:22:27.799898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86309f26-9b8d-4adc-99dc-58035fd33c81 (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:27.845774 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86309f26-9b8d-4adc-99dc-58035fd33c81 (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:27.846514 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86309f26-9b8d-4adc-99dc-58035fd33c81', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:22:27.846514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '104')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:27.847607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea', '105')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:27.848675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482c0fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:22:27.848898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:22:27.849124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 3300000009cb570cf {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:22:27.904138 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:27.932622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:27.995981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:28.062068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:22:28.062068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:22:28.064953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:22:28.081174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:22:28.084735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:22:28.104272 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.117403 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Applying migration context for instance bef8f03b-9d16-489d-904e-04fbce74b056 as it has an incoming, in-progress migration 998a8513-ae4f-42dc-b889-01d52f89309d. Migration status is post-migrating {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 13 04:22:28.118745 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating resource usage from migration 998a8513-ae4f-42dc-b889-01d52f89309d
May 13 04:22:28.145506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.40.100,3260]
May 13 04:22:28.145506 np0000000669 nova-compute[97951]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.40.100,3260] successful.
May 13 04:22:28.145506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.188940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.196786 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.196786 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.196786 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.196981 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.196981 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.196981 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.197193 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e44483e5-9065-40b6-a4ea-12eb9109fea5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.197193 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 76650676-a82a-4545-8a20-9a44c8ac7419 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.197193 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Migration 998a8513-ae4f-42dc-b889-01d52f89309d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 13 04:22:28.197336 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bef8f03b-9d16-489d-904e-04fbce74b056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:22:28.197466 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:22:28.197585 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:22:27 up 36 min,  2 users,  load average: 9.26, 8.26, 5.10\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '5', 'io_workload': '0', 'num_proj_016554a7d54c4781a53b6ddb1f2e81e2': '1', 'num_task_resize_migrated': '1', 'num_vm_stopped': '1', 'num_task_deleting': '1', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_proj_7e642c6f91a844b89aaaca335f536052': '1', 'num_proj_e227d582564c4ef7b5ab8d19583df520': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:22:28.203460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.246748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.50.100,3260]
May 13 04:22:28.246748 np0000000669 nova-compute[97951]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-fd8ff985-d9e6-49a4-8bf7-647b5f234dea, portal: 192.168.50.100,3260] successful.
May 13 04:22:28.246748 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.273833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:28.275418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:28.275418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (476ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:28.275418 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:22:28.279201 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Deleting instance files /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf_del
May 13 04:22:28.280231 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Deletion of /opt/stack/data/nova/instances/e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf_del complete
May 13 04:22:28.353157 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:28.525498 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:28.789088 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Took 1.54 seconds to destroy the instance on the hypervisor.
May 13 04:22:28.789809 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:22:28.790024 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:22:28.790157 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:22:28.790423 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:28.849938 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:28.850196 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:28.927720 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:29.030718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:29.354040 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:29.521418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cbcb8f6a-fc56-477e-b041-4d6f3247b401 req-d2f0b866-3cb4-4b20-a6e6-2346b1e5682b service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Received event network-vif-deleted-246df767-9479-4cb6-abe2-7b5641bb9fee {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:29.521418 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-cbcb8f6a-fc56-477e-b041-4d6f3247b401 req-d2f0b866-3cb4-4b20-a6e6-2346b1e5682b service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Neutron deleted interface 246df767-9479-4cb6-abe2-7b5641bb9fee; detaching it from the instance and deleting it from the info cache
May 13 04:22:29.521418 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cbcb8f6a-fc56-477e-b041-4d6f3247b401 req-d2f0b866-3cb4-4b20-a6e6-2346b1e5682b service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:29.539823 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:29.553264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:22:29.584566 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:29.633157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:22:29.633468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:22:29.648744 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:22:29.650206 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe13:1282', 'fe80::9ce9:5ff:fe57:2962', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe6d:b876', 'fe80::209c:c2ff:fe09:82a1', 'fe80::fc16:3eff:fe95:57a', 'fe80::209d:c7ff:fe47:bc28'] 
May 13 04:22:29.650350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:22:29.650415 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:22:29.650736 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:29.845435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:29.865406 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:22:29.865626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.778s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:29.866530 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:22:29.938041 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:30.025966 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cbcb8f6a-fc56-477e-b041-4d6f3247b401 req-d2f0b866-3cb4-4b20-a6e6-2346b1e5682b service nova] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Detach interface failed, port_id=246df767-9479-4cb6-abe2-7b5641bb9fee, reason: Instance e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:22:30.441578 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Took 1.65 seconds to deallocate network for instance.
May 13 04:22:30.810765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Starting finish_migration {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 04:22:30.812926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:22:30.813156 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Creating image(s)
May 13 04:22:30.814059 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:30.929980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:30.930522 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:22:30.930857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:31.020846 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Took 0.58 seconds to detach 1 volumes for instance.
May 13 04:22:31.063930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:31.065129 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:22:31.530620 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:31.530865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:31.568609 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:22:31.571344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Ensure instance console log exists: /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:22:31.571344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:31.571344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:31.571344 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:31.573977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start _get_guest_xml network_info=[{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'bef8f03b-9d16-489d-904e-04fbce74b056', 'attached_at': '2026-05-13T04:22:30.000000', 'detached_at': '', 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'multiattach': True, 'serial': '47665bd1-526c-4195-a0e3-3a9059be3304'}, 'disk_bus': 'virtio', 'attachment_id': '76c6f6cb-4e4e-40ef-aced-8bc5b83465a4', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:22:31.578353 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:22:31.580792 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='bef8f03b-9d16-489d-904e-04fbce74b056'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646151.580039) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:22:31.583192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:22:31.584277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:22:31.590519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:22:31.590519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:22:31.590519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:22:31.591001 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:22:31.591459 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:22:31.591700 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:22:31.592074 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:22:31.592432 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:22:31.592656 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:22:31.592957 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:22:31.593194 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:22:31.593496 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:22:31.593756 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:22:31.594027 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:22:31.618369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:31.723124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:31.725369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:31.726036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:31.726307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:22:31.741559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:31.745386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:31.745982 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:31.746058 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:31.746591 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:31.746858 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:31.761356 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:31.761356 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:31.764961 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:31.764961 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:31.770562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:31.780188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.791265 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:31.791889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:31.791889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:31.792549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('19', '0', '0', 0) found on session 116 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:31.792613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.804046 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527db567-9f3e-4f73-b83b-aff43a660095 (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:31.804352 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:31.804523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:31.804523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:31.805317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 116 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:31.805598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:31.806385 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('18', '0', '0', 0) found on session 115 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:31.806505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:31.817399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 115 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:31.817842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:31.864693 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.865181 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.865413 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.865785 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.866641 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.870257 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:22:31.870546 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:22:31.870857 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.22 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:22:32.148757 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:32.149140 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:32.652123 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:32.746739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:22:32.788701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:33.158711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.628s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:33.219605 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf
May 13 04:22:33.766986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000caa612da for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:22:33.767603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:33.767603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (2041ms) {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:33.767833 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:22:33.981027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:33.981825 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:34.229392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-58376811-ed30-4855-a919-3ba9c83af95d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.492s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:34.276080 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:30Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:22:34.276290 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:34.276990 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:34.279865 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] End _get_guest_xml xml=<domain type="qemu">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <uuid>bef8f03b-9d16-489d-904e-04fbce74b056</uuid>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <name>instance-00000030</name>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <memory>262144</memory>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-0</nova:name>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:22:31</nova:creationTime>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.micro" id="84">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:memory>256</nova:memory>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         <nova:port uuid="3d23fe88-4cef-4e24-9b41-83156fdda4d0">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <system>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="serial">bef8f03b-9d16-489d-904e-04fbce74b056</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="uuid">bef8f03b-9d16-489d-904e-04fbce74b056</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </system>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <os>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </os>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <features>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </features>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   <devices>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk.config"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-11"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <shareable/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:9e:60:9d"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <target dev="tap3d23fe88-4c"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </interface>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/console.log" append="off"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </serial>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <video>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </video>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </rng>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:   </devices>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]: </domain>
May 13 04:22:34.279865 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:30Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:9e:60:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.283244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:34.283846 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:22:34.284466 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.284668 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e985d4d0-5ca9-5037-a21d-a9780c90f82e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:34.285504 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.286417 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:34.290180 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.290383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d23fe88-4c, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:34.290823 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d23fe88-4c, col_values=(('qos', UUID('75924a53-b8fb-4dfe-aaa0-4e93a2fee86c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:34.291030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d23fe88-4c, col_values=(('external_ids', {'iface-id': '3d23fe88-4cef-4e24-9b41-83156fdda4d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:60:9d', 'vm-uuid': 'bef8f03b-9d16-489d-904e-04fbce74b056'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:34.292354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.293883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:34.298115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.299092 np0000000669 nova-compute[97951]: INFO os_vif [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c')
May 13 04:22:34.484005 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Detaching volume 97c37cea-2ee3-4bfa-b782-a46c173fed0a
May 13 04:22:34.521879 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Attempting to driver detach volume 97c37cea-2ee3-4bfa-b782-a46c173fed0a from mountpoint /dev/vdb
May 13 04:22:34.526190 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found disk vdb by alias ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:22:34.529166 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Found disk vdb by alias ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:22:34.529329 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Attempting to detach device vdb from instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:22:34.529808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <alias name="ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a"/>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <serial>97c37cea-2ee3-4bfa-b782-a46c173fed0a</serial>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]: </disk>
May 13 04:22:34.529808 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:22:34.539301 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully detached device vdb from instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 from the persistent domain config.
May 13 04:22:34.539505 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] (1/8): Attempting to detach device vdb with device alias ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a from instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:22:34.541088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <alias name="ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a"/>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <serial>97c37cea-2ee3-4bfa-b782-a46c173fed0a</serial>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]: </disk>
May 13 04:22:34.541088 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:22:34.826133 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:34.848303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:35.085368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646155.084906, dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 => ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:22:35.086526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-97c37cea-2ee3-4bfa-b782-a46c173fed0a for instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:22:35.088798 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully detached device vdb from instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 from the live domain config.
May 13 04:22:35.089969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:22:35.090210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:35.090364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:35.090721 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:35.091017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c37cea-2ee3-4bfa-b782-a46c173fed0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:22:35.091473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:35.125034 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsi session list stdout=tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:35.125371 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:35.125371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:22:35.125718 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '107')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:35.126434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a', '106')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:35.127694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480f5760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'): ({'sdh'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:22:35.127938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:22:35.128239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Flush multipath device 330000000dedce61e {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:22:35.164118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:35.211127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:35.253045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:22:35.253500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:22:35.254408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:22:35.268392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:22:35.268597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:22:35.281844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.313937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.40.100,3260]
May 13 04:22:35.313937 np0000000669 nova-compute[97951]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.40.100,3260] successful.
May 13 04:22:35.313937 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.333447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.351340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.383602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.50.100,3260]
May 13 04:22:35.383602 np0000000669 nova-compute[97951]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-97c37cea-2ee3-4bfa-b782-a46c173fed0a, portal: 192.168.50.100,3260] successful.
May 13 04:22:35.383602 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.398504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:35.398754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:35.398901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] <== disconnect_volume: return (308ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:35.399069 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:22:35.819504 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:35.820285 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:35.820285 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:35.820679 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:9e:60:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:22:35.821703 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Using config drive
May 13 04:22:35.949883 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'flavor' on Instance uuid dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:36.219145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:36.243031 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:36.336566 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:36.337372 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:36.346574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:36.403934 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:36.404110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:36.404246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:36.404373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:36.404579 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:36.404579 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-62ccf2f0-b4d9-4cb2-8a44-02539b4224b8 req-1805f44a-d7ae-44a6-96fd-63a4bc5f5bed service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received unexpected event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with vm_state active and task_state resize_finish.
May 13 04:22:36.662805 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000653394999972079 future=<Future at 0x7a463c3420f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:36.662892 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:36.663071 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1098598620001212 future=<Future at 0x7a461c7ad850 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:36.663134 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1097429950000333 future=<Future at 0x7a461c7ad850 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:36.663767 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646141.6620114, e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:36.663882 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] VM Stopped (Lifecycle Event)
May 13 04:22:36.955877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ce67be58-05d3-408d-b3d1-fd2afdbdc228 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.974s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:36.987968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for bef8f03b-9d16-489d-904e-04fbce74b056 due to new event <LifecycleEvent: 1778646156.9876566, bef8f03b-9d16-489d-904e-04fbce74b056 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:22:36.988105 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646156.9876566, bef8f03b-9d16-489d-904e-04fbce74b056 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:36.988220 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Resumed (Lifecycle Event)
May 13 04:22:36.989196 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:22:36.992421 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance running successfully.
May 13 04:22:36.993268 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Failed to set time: agent not configured {{(pid=97951) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 04:22:36.993406 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32f238e0-3d3e-481f-b683-33634f6df7d7 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] finish_migration finished successfully. {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 04:22:37.167114 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-a0fdeb8f-991c-4e15-8b1a-33fe3bff36d4 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e7d3d9a5-7f37-4d83-b6ce-58f88b8d0caf] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:37.207140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:37.207439 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:37.207572 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:37.207764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:37.207920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:37.210315 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Terminating instance
May 13 04:22:37.491001 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:37.494866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:37.713281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:22:37.735789 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:37.738511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:37.764646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:37.771807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:37.774942 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0020262819998606574 future=<Future at 0x7a461c7ad850 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:37.775161 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:37.799714 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:37.999786 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 04:22:38.000069 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646157.9998744, bef8f03b-9d16-489d-904e-04fbce74b056 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:38.000287 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Started (Lifecycle Event)
May 13 04:22:38.070142 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Instance destroyed successfully.
May 13 04:22:38.070688 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lazy-loading 'resources' on Instance uuid dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:38.496304 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:38.496729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:38.496868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:38.496988 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:38.497126 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:38.497225 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received unexpected event network-vif-plugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with vm_state resized and task_state None.
May 13 04:22:38.497416 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:38.497483 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:38.497654 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:38.497776 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:38.497949 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] No waiting events found dispatching network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:38.498015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:22:38.498133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:38.498265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Acquiring lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:38.498471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:38.498511 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:38.498616 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] No waiting events found dispatching network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:38.498727 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6effc09d-dcb4-4cec-bcb9-42ef14d8d3cb req-4f0cd828-2542-4b8d-a6c4-406c0b19a22d service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-unplugged-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:22:38.505346 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:38.507682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:38.573180 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-265770418',display_name='tempest-VolumesBackupsTest-instance-265770418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumesbackupstest-instance-265770418',id=44,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8kBMq8ErmYFGtVMZNH7XnUJ65yQOm8GDHmTrpcdgG1nt9fXMaA/8zYH5OnvnTErTnX3uHlLOEjUfSXbZI9DguftpPBhssPqRhFURwP7rLfvn6myTJqZX/M6alvLVqduA==',key_name='tempest-keypair-1495567488',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:47Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='016554a7d54c4781a53b6ddb1f2e81e2',ramdisk_id='',reservation_id='r-9zo0uj86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-986605255',owner_user_name='tempest-VolumesBackupsTest-986605255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4020376a6d94b8f88c2e952c7a198ee',uuid=dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:22:38.573419 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converting VIF {"id": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "address": "fa:16:3e:13:12:82", "network": {"id": "631c2a61-5efb-46c4-b7ce-b8a11d02986f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1602642954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "016554a7d54c4781a53b6ddb1f2e81e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape01dce11-aa", "ovs_interfaceid": "e01dce11-aaaa-49cd-81e5-1f6dfb18da99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:38.573991 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:38.574223 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:22:38.575611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.575878 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape01dce11-aa, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:38.576950 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.577715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:38.578091 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.579102 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.579258 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa12c862-4e7b-4aa2-b36f-169276bdb7cb) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:38.579821 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.580300 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:38.580788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:38.582673 np0000000669 nova-compute[97951]: INFO os_vif [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:12:82,bridge_name='br-int',has_traffic_filtering=True,id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99,network=Network(631c2a61-5efb-46c4-b7ce-b8a11d02986f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01dce11-aa')
May 13 04:22:38.582967 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Deleting instance files /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9_del
May 13 04:22:38.583809 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Deletion of /opt/stack/data/nova/instances/dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9_del complete
May 13 04:22:39.009943 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99974703099997 future=<Future at 0x7a4648534560 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:39.010661 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999029319999863 future=<Future at 0x7a4648534560 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:39.010764 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998880673999793 future=<Future at 0x7a4648534560 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:39.089548 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 04:22:39.089999 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:22:39.090286 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:22:39.090359 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:22:39.090626 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:39.215904 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:39.223154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:39.223302 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:39.223503 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Going to confirm migration 3 {{(pid=97951) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 04:22:39.656084 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-08c563d3-7801-4807-9c02-ac8e2b8297c0 req-593ca4f0-1a55-4b10-ab5b-86de63a2d632 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Received event network-vif-deleted-e01dce11-aaaa-49cd-81e5-1f6dfb18da99 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:39.657863 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-08c563d3-7801-4807-9c02-ac8e2b8297c0 req-593ca4f0-1a55-4b10-ab5b-86de63a2d632 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Neutron deleted interface e01dce11-aaaa-49cd-81e5-1f6dfb18da99; detaching it from the instance and deleting it from the info cache
May 13 04:22:39.658075 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-08c563d3-7801-4807-9c02-ac8e2b8297c0 req-593ca4f0-1a55-4b10-ab5b-86de63a2d632 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:39.735712 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:39.850166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:39.879566 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:39.879566 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:39.879566 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:39.879566 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:39.879566 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'info_cache' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:40.101319 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:40.162741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-08c563d3-7801-4807-9c02-ac8e2b8297c0 req-593ca4f0-1a55-4b10-ab5b-86de63a2d632 service nova] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Detach interface failed, port_id=e01dce11-aaaa-49cd-81e5-1f6dfb18da99, reason: Instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:22:40.224636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:40.224816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:40.366817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:40.366995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:40.367093 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Shelve offloading
May 13 04:22:40.603859 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Took 1.51 seconds to deallocate network for instance.
May 13 04:22:40.727058 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:22:40.883740 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:41.112482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:41.112482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:41.250683 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:41.334764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:41.406301 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.413695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.433730 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.436840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.464170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.464710 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:41.508029 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:41.738680 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999617801000113 future=<Future at 0x7a463c3289b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:41.744094 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance destroyed successfully.
May 13 04:22:41.744790 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'numa_topology' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:41.771428 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:41.772170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:41.772406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:41.772532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:41.772660 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:41.772788 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-66802798-4eba-4a74-b4da-ad83c904408a req-039cf5bf-e44a-423a-9459-e6ef39bb6a55 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received unexpected event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with vm_state active and task_state shelving.
May 13 04:22:41.819899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:41.820118 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:42.011309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:42.011496 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'migration_context' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:42.248516 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:42.250117 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:42.250212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:42.250347 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:42.322817 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:42.513654 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Object Instance<bef8f03b-9d16-489d-904e-04fbce74b056> lazy-loaded attributes: info_cache,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:22:42.521709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:42.755343 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:42.829027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.717s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:42.830843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.495s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:42.836425 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:42.836425 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Claim successful on node np0000000669
May 13 04:22:42.920415 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Deleted allocations for instance dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9
May 13 04:22:43.159847 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:43.308851 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:43.582529 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:43.811625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:43.811625 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:43.811625 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:43.846690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:43.847644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:43.847871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:43.848004 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:43.848135 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:22:43.848457 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e8254ab7-8707-4813-a95d-7fe958deffe4 req-c70f31cc-a107-4a1c-b3d6-845070e6bb17 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received unexpected event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with vm_state active and task_state shelving.
May 13 04:22:43.934119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-817f62ec-d2af-4c39-bf95-bbef680f5271 tempest-VolumesBackupsTest-986605255 tempest-VolumesBackupsTest-986605255-project-member] Lock "dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.727s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:44.375713 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance destroyed successfully.
May 13 04:22:44.375948 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'resources' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:44.448767 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:44.448890 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing instance network info cache due to event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:44.449075 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:44.449259 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:44.449428 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:44.466943 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:44.467345 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:44.851957 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.880688 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Object Instance<e44483e5-9065-40b6-a4ea-12eb9109fea5> lazy-loaded attributes: numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:22:44.881499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7nAvRnQj9V+BRBsiL8wNdE+Q7/iisL31osE7FWHwcXXz6yD+do17RY1dKHTC32CIpRr241qaXyv9AlFU4UugAxUowd+86kbE0PVrvZM9luOAjm3SsVe3FP7NKdLQd+dw==',key_name='tempest-TestShelveInstance-1344705829',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:00Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:22:44.881786 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:44.882249 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:44.882518 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:22:44.883432 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.883662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8d889b7-1f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:44.884732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.885665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:44.887282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.888156 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.888314 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dd94b58-8d0f-4acb-8e90-9c69f6a2d974) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:44.889884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:44.890794 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:44.892657 np0000000669 nova-compute[97951]: INFO os_vif [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f')
May 13 04:22:44.894103 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:22:44.894443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:44.894615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:44.894954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:44.895310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:22:44.895453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:44.921124 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:44.921569 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:22:44.921569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '113')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:44.922685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '114')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:22:44.923565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b4040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'): ({'sdl'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:22:44.923780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Removing multipathed devices sdk, sdl {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:22:44.924017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flush multipath device 3300000001288eeaa {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:22:44.956829 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:44.970730 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:44.977493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:45.018000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:22:45.067738 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:22:45.067738 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:22:45.067738 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:22:45.084097 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:22:45.084672 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:22:45.099340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.134927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260]
May 13 04:22:45.134927 np0000000669 nova-compute[97951]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260] successful.
May 13 04:22:45.134927 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.153301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.176830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.219399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260]
May 13 04:22:45.219399 np0000000669 nova-compute[97951]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260] successful.
May 13 04:22:45.219399 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.239729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:45.239943 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:45.240061 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== disconnect_volume: return (345ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:45.240180 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:22:45.240453 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deleting instance files /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5_del
May 13 04:22:45.240967 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deletion of /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5_del complete
May 13 04:22:45.267878 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:45.377695 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:45.479829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.648s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:45.479829 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:22:45.480415 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.959s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:45.576673 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updated VIF entry in instance network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:45.577296 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": null, "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:45.983490 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:22:45.984167 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:22:45.984167 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:45.984381 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:46.080984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fda31ff9-2a18-4bae-aebf-a79a4b1c8ff4 req-84b9426b-0918-4d30-bf64-0bb87c5bea8a service nova] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:46.119408 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:22:46.487129 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:22:46.581183 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:46.581490 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:46.826484 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Successfully created port: 8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:22:46.991003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:22:47.002947 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Deleted allocations for instance e44483e5-9065-40b6-a4ea-12eb9109fea5
May 13 04:22:47.085724 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:47.256421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:47.497713 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Booting with volume 96d80945-e6ff-4036-8b7b-23cce1da40d5 at /dev/vda
May 13 04:22:47.511756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:47.572120 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:47.594629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:22:47.627256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:47.704112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:22:47.704285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:22:47.715540 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:22:47.719348 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe95:57a', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe9e:609d'] 
May 13 04:22:47.719348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:22:47.719348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:22:47.719348 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:47.719348 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating existing volume attachment record: f98df612-ce8d-43ac-b083-90b975789ad2 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:22:48.107074 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.624s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:48.107534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.594s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:48.246385 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Successfully updated port: 8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:22:48.319761 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-changed-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:48.319915 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Refreshing instance network info cache due to event network-changed-8c7a930e-436e-4b0c-bff9-aa5f89b05d30. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:48.320182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] Acquiring lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:48.320237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] Acquired lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:48.320344 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Refreshing network info cache for port 8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:48.703957 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:48.704255 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:48.749424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:48.803355 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocation for migration 998a8513-ae4f-42dc-b889-01d52f89309d
May 13 04:22:48.827638 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:48.903757 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:22:49.074807 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:49.206966 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:49.309173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7068bb06-0de1-4be0-9e6d-4750383b2597 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 10.086s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:49.335150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:49.401989 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:49.577918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-03a9d941-3a42-4570-8a82-11835d62c623 req-14f1b935-d01f-49d6-a851-254165ea1a5f service nova] Releasing lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:49.578159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:49.578336 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:49.715751 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.611s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:49.856027 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:49.869056 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:22:49.874128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:22:49.874218 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Creating image(s)
May 13 04:22:49.874650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:22:49.874923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Ensure instance console log exists: /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:22:49.875173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:49.875381 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:49.875568 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:49.889717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:50.141400 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:22:50.227279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-defc9fd8-8ebd-4480-8cf0-47e740ad1600 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.860s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:50.228855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.826s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:50.229091 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Unshelving
May 13 04:22:50.330604 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:50.502313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:50.549515 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating instance_info_cache with network_info: [{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:51.051457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:51.051804 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance network_info: |[{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:22:51.054017 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start _get_guest_xml network_info=[{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c510b785-b650-485f-bb5b-f268ed5742e3', 'attached_at': '', 'detached_at': '', 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'serial': '96d80945-e6ff-4036-8b7b-23cce1da40d5'}, 'disk_bus': 'virtio', 'attachment_id': 'f98df612-ce8d-43ac-b083-90b975789ad2', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:22:51.057624 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:22:51.059316 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1205957394', uuid='c510b785-b650-485f-bb5b-f268ed5742e3'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646171.0588388) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:22:51.060996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:22:51.063001 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:22:51.066758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:22:51.069343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:22:51.069809 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:22:51.070030 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:22:51.070411 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:22:51.070697 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:22:51.070960 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:22:51.087513 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:22:51.088049 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:51.088362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:51.088783 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:51.089376 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:22:51.109725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:51.110902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:51.111779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:51.112048 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:51.112784 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:51.113035 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:51.128841 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:22:51.128841 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:51.139011 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:22:51.139011 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:51.159676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5] added
May 13 04:22:51.159676 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:22:51.159676 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:51.159676 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:51.159676 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:51.159676 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:51.159676 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:51.160014 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:22:51.165878 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0481(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:22:51.166131 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5] added
May 13 04:22:51.168159 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:51.168159 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0539(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:22:51.168159 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:22:51.238157 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Booting with volume f8925d06-5a4a-4aea-9692-34140d6314a0 at /dev/vda
May 13 04:22:51.306662 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:51.321264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:22:51.348087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:51.403582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:22:51.403893 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:22:51.414268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:22:51.415657 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe95:57a', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe9e:609d'] 
May 13 04:22:51.415863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:22:51.418846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:22:51.419138 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:51.419439 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating existing volume attachment record: a1cdbbd2-12cf-4506-87d4-dc21e69b6b96 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:22:51.714845 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:51.715042 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing instance network info cache due to event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:51.715466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:51.715690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:51.715887 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:52.167019 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:52.167599 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:52.184652 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:52.184652 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:52.198506 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:52.198506 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.209296 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.218369 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:52.223098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.225617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.225617 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.225617 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.225617 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.225617 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:52.228210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.228210 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.228210 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.228210 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.228210 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:52.237689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.237689 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.237689 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.237689 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.237689 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:52.237980 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.237980 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.237980 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.237980 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.237980 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:52.286511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260]
May 13 04:22:52.286511 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260] successful.
May 13 04:22:52.286511 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.301532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260]
May 13 04:22:52.301532 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260] successful.
May 13 04:22:52.301532 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.303085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.318933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.328395 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.328766 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:52.329153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:52.329153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:52.330080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('9', '-', '-', 0) found on session 121 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:52.330214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:52.342990 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:52.344456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:52.344456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:52.345713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('10', '-', '-', 0) found on session 122 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:52.352192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:52.352192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 121 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:52.352192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:52.368433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 122 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:52.368433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:52.797298 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:52.986476 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updated VIF entry in instance network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:52.986783 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:53.106831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:53.113917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:22:53.159152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:53.159927 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:53.164231 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'pci_requests' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:53.489630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e8481a9d-cbe1-4e3f-9b68-6c2dc25c1181 req-fbc12eba-1072-42ea-92b6-f0e32463d463 service nova] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:53.667988 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'numa_topology' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:53.774830 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:53.774970 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing instance network info cache due to event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:53.775118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:53.775201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:53.775296 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:54.010992 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0012899900002594222 future=<Future at 0x7a4648534560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:54.011527 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646159.0095904, dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:54.011720 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:54.011880 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] VM Stopped (Lifecycle Event)
May 13 04:22:54.012870 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.7253886700000294 future=<Future at 0x7a463c3289b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:54.012967 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.7252775330002805 future=<Future at 0x7a463c3289b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:54.138177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 3300000000e99ff7b for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:22:54.138177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:54.138177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '3300000000e99ff7b', 'path': '/dev/dm-3', 'multipath_id': '3300000000e99ff7b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:54.138507 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e99ff7b', 'path': '/dev/dm-3', 'multipath_id': '3300000000e99ff7b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:22:54.173262 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:54.173505 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Claim successful on node np0000000669
May 13 04:22:54.278850 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:54.424314 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:54.424621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:54.516580 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: dc29d68e-05e3-47b8-9d88-51e3fe7a5fc9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:54.651525 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:54.656358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:22:54.656761 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:54.657610 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:54.659148 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:54.763990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:54.763990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:54.858881 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updated VIF entry in instance network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:54.860028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:54.864509 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:54.891269 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:54.928415 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] End _get_guest_xml xml=<domain type="qemu">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <uuid>c510b785-b650-485f-bb5b-f268ed5742e3</uuid>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <name>instance-00000035</name>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-1205957394</nova:name>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:22:51</nova:creationTime>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         <nova:port uuid="8c7a930e-436e-4b0c-bff9-aa5f89b05d30">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <system>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="serial">c510b785-b650-485f-bb5b-f268ed5742e3</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="uuid">c510b785-b650-485f-bb5b-f268ed5742e3</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </system>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <os>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </os>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <features>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </features>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   <devices>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <alias name="ua-96d80945-e6ff-4036-8b7b-23cce1da40d5"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <serial>96d80945-e6ff-4036-8b7b-23cce1da40d5</serial>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </disk>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:cf:8b:3f"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <target dev="tap8c7a930e-43"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </interface>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/console.log" append="off"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </serial>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <video>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </video>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </rng>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:   </devices>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: </domain>
May 13 04:22:55.165254 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Preparing to wait for external event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:22:55.165254 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:22:55.167611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.167611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:55.167611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:22:55.169110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.169316 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0254d4a2-8c64-5068-a73a-a361fe54708f', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:55.170392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.170969 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:55.171663 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.174485 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.174703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7a930e-43, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:55.175037 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7a930e-43, col_values=(('qos', UUID('5f5e3fb8-c08d-43f3-bd05-913a8621f4ab')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:55.175246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7a930e-43, col_values=(('external_ids', {'iface-id': '8c7a930e-436e-4b0c-bff9-aa5f89b05d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:8b:3f', 'vm-uuid': 'c510b785-b650-485f-bb5b-f268ed5742e3'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:22:55.176513 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.178244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:22:55.186796 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:55.186796 np0000000669 nova-compute[97951]: INFO os_vif [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43')
May 13 04:22:55.271018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:22:55.369076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-468ac22c-2897-499b-8928-6297ac6ce808 req-faddc207-d00d-468b-a643-2b216e306e2a service nova] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:55.766993 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:55.767427 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:55.832277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:55.934288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:56.269888 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:56.710682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:56.710800 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:22:56.710831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:cf:8b:3f, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:22:56.711183 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Using config drive
May 13 04:22:56.738645 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00035265899987280136 future=<Future at 0x7a463c3289b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:56.739208 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646161.7381911, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:56.739421 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:22:56.739600 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Stopped (Lifecycle Event)
May 13 04:22:56.776816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.617s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:56.777254 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:56.778641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.947s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:56.781648 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:56.781769 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Claim successful on node np0000000669
May 13 04:22:56.830127 np0000000669 nova-compute[97951]: INFO nova.network.neutron [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating port c8d889b7-1f3e-4898-9838-0d40c92de7f5 with attributes {'binding:host_id': 'np0000000669', 'device_owner': 'compute:nova'}
May 13 04:22:56.957063 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:56.957222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:56.998218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:56.998681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:56.998843 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Attaching volume 69d8a13a-0c0b-4468-a587-45569dcc2c8e to /dev/vdb
May 13 04:22:57.035121 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:57.049430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:22:57.072920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:57.121066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:22:57.121380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:22:57.130349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:22:57.131707 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe95:57a', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe9e:609d'] 
May 13 04:22:57.131860 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:22:57.131992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:22:57.132341 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:22:57.132585 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updating existing volume attachment record: 12231b4c-18bb-4347-88ba-a4b7116b04e7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:22:57.216917 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:57.242264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c8c3e8b5-d06a-4052-a21c-3212fad97425 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:57.280181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:57.280339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:57.280501 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:22:57.324863 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Creating config drive at /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config
May 13 04:22:57.328786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:57.328930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing instance network info cache due to event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:22:57.329052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:22:57.331894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp63atk10z {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:22:57.385035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp63atk10z" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:22:57.459312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:22:57.704438 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '76650676-a82a-4545-8a20-9a44c8ac7419', 'attached_at': '', 'detached_at': '', 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'serial': '69d8a13a-0c0b-4468-a587-45569dcc2c8e'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:22:57.706105 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:22:57.706502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:57.706648 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:57.707071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:57.707289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:22:57.719236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:57.719755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:57.720127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:57.720359 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:57.720696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:22:57.720875 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:57.730884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:22:57.730884 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:57.734992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:22:57.734992 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:57.741534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e] added
May 13 04:22:57.741534 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:22:57.741534 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:57.741534 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:57.741534 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:57.741534 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:57.741534 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:57.741794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:22:57.741794 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:22:57.741953 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:22:57.745199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e] added
May 13 04:22:57.745199 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:22:57.745199 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:57.745199 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:57.745199 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:22:57.745199 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:22:57.745199 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:57.745507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:22:57.745573 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:22:57.745728 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:22:57.783740 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:57.795621 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:57.816011 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:57.877877 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.000795 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-98cf70a9-6ea1-41ea-b6fc-12c950dbcab1 req-caea763f-91ed-42ac-b501-6b699f047667 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:22:58.001836 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98cf70a9-6ea1-41ea-b6fc-12c950dbcab1 req-caea763f-91ed-42ac-b501-6b699f047667 service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:58.002983 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98cf70a9-6ea1-41ea-b6fc-12c950dbcab1 req-caea763f-91ed-42ac-b501-6b699f047667 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:58.003173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-98cf70a9-6ea1-41ea-b6fc-12c950dbcab1 req-caea763f-91ed-42ac-b501-6b699f047667 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:58.003371 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-98cf70a9-6ea1-41ea-b6fc-12c950dbcab1 req-caea763f-91ed-42ac-b501-6b699f047667 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Processing event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:22:58.040459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:58.086970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.088742 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.094436 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.095963 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.121918 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:58.209074 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:58.370606 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:58.390136 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:22:58.390416 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:22:58.544414 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646178.5440397, c510b785-b650-485f-bb5b-f268ed5742e3 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:58.544823 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:22:58.545537 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Started (Lifecycle Event)
May 13 04:22:58.547779 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:22:58.553187 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance spawned successfully.
May 13 04:22:58.553581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:22:58.742315 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:22:58.746070 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:58.754881 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:58.754881 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:22:58.759891 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:22:58.759891 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.767056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.773656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.781674 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.781858 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.791353 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:58.825239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.40.100,3260]
May 13 04:22:58.825239 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.40.100,3260] successful.
May 13 04:22:58.825239 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.830492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.50.100,3260]
May 13 04:22:58.830492 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.50.100,3260] successful.
May 13 04:22:58.830492 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.836146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.842919 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.851661 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.851972 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:58.852176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:58.852232 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:58.853283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('11', '-', '-', 0) found on session 123 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:58.853411 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:22:58.859437 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:22:58.859437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:22:58.860728 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('12', '-', '-', 0) found on session 124 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:22:58.860915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:22:58.872013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 123 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:58.872482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:58.872841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:22:58.874123 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating image(s)
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Ensure instance console log exists: /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:22:58.882552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:22:58.883434 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:58.883434 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:58.884038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start _get_guest_xml network_info=[{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e44483e5-9065-40b6-a4ea-12eb9109fea5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'serial': 'f8925d06-5a4a-4aea-9692-34140d6314a0'}, 'disk_bus': 'virtio', 'attachment_id': 'a1cdbbd2-12cf-4506-87d4-dc21e69b6b96', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:22:58.885411 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 124 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:22:58.885411 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:22:58.887898 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:22:58.889480 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-683657741', uuid='e44483e5-9065-40b6-a4ea-12eb9109fea5'), owner=OwnerMeta(userid='f50ff3fb0b4c41dea9c79fe8d54cf794', username='tempest-TestShelveInstance-592071318-project-member', projectid='7e642c6f91a844b89aaaca335f536052', projectname='tempest-TestShelveInstance-592071318'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646178.8891377) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:22:58.891648 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:22:58.891648 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:22:58.893109 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:22:58.899011 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:22:58.904734 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:22:58.906049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:22:58.906710 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:22:58.906908 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:22:58.907048 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:22:58.907571 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:22:58.907571 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:22:58.907571 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:22:58.907688 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:22:58.907829 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:22:58.907973 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:22:58.908071 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:22:58.908186 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:22:58.908397 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'vcpu_model' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:22:59.048212 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:59.050570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:22:59.061902 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.062064 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.062296 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.062591 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.063143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.063392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:22:59.381850 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:59.407631 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.629s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:22:59.408996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.368s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:22:59.408996 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:22:59.411481 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Object Instance<e44483e5-9065-40b6-a4ea-12eb9109fea5> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:22:59.423207 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:22:59.423207 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Claim successful on node np0000000669
May 13 04:22:59.432077 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:22:59.432473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:22:59.432634 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:22:59.555389 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:22:59.555670 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646179.5555205, c510b785-b650-485f-bb5b-f268ed5742e3 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:22:59.555806 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Paused (Lifecycle Event)
May 13 04:22:59.567787 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Took 9.70 seconds to spawn the instance on the hypervisor.
May 13 04:22:59.567944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:22:59.721006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:22:59.741172 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:59.874765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:22:59.879091 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updated VIF entry in instance network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:22:59.879441 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:22:59.931971 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:22:59.933894 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:22:59.935930 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:22:59.935930 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:00.011062 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e08e49a99fec460bba306ad25f253e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b898af52668467f9702dfec1b5d34bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:23:00.057972 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:00.062727 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646180.0623972, c510b785-b650-485f-bb5b-f268ed5742e3 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:00.063097 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Resumed (Lifecycle Event)
May 13 04:23:00.077691 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Took 18.84 seconds to build instance.
May 13 04:23:00.105317 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:00.105534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:00.105709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:00.105812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:00.105925 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:00.106048 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7c93c833-2a63-465d-8efe-827693db65ac req-65c81daf-4cc8-4a24-a144-b3dc7150df8e service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received unexpected event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with vm_state active and task_state None.
May 13 04:23:00.177945 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:00.381423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f1a2fb30-76d0-458a-a887-337a3cd8c816 req-709a3141-dc92-431f-b5ab-b40131da5f48 service nova] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:00.442596 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:23:00.566602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:00.568141 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:00.578809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.354s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:00.603851 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Successfully created port: f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:23:00.744773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found WWN 3300000004a25cffd for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:00.744773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:00.745399 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.313s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:00.746059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:00.747474 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000004a25cffd', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000004a25cffd'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:00.750360 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004a25cffd', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000004a25cffd'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:00.754575 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:23:00.754575 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:23:00.754575 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:23:00.764950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:00.765458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:00.765645 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:00.766551 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:00.769199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:00.769199 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:00.786846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:00.786846 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:00.790659 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.luks [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 04:23:00.791536 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:23:00.791948 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:23:00.792214 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:23:00.793405 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7a463c7c4740>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '76650676-a82a-4545-8a20-9a44c8ac7419', 'attached_at': '', 'detached_at': '', 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'serial': '69d8a13a-0c0b-4468-a587-45569dcc2c8e'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:23:00.793405 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] formatting encrypted volume /dev/dm-6 {{(pid=97951) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 04:23:00.796906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:00.796906 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0] added
May 13 04:23:00.818793 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:00.818793 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0493(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:00.818793 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:00.819183 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0] added
May 13 04:23:00.819183 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:00.819183 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:00.819183 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:00.819183 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:00.819183 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:00.819183 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:00.819308 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:00.819541 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0538(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:00.819694 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:00.948363 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:23:01.071911 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:01.072080 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:01.216905 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Successfully updated port: f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:23:01.452982 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Booting with volume 22150768-1468-48ea-b0f7-0236d97df34e at /dev/vda
May 13 04:23:01.500835 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:01.512503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:23:01.537179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:01.576601 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:01.583665 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:23:01.583665 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:23:01.597350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:23:01.597350 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fe95:57a', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fecf:8b3f', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:23:01.597350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:23:01.597350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:23:01.597350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:01.597762 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating existing volume attachment record: 4c26ebf9-d3f2-484d-b333-1ea79aeca350 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:23:01.719961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:01.720100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:01.720283 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:01.819815 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:01.820372 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:01.837294 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:01.837294 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:01.841095 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:01.841095 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.860293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.870139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.886091 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.886999 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.895054 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.895453 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:01.939028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260]
May 13 04:23:01.939028 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260] successful.
May 13 04:23:01.939028 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.948978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260]
May 13 04:23:01.948978 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260] successful.
May 13 04:23:01.948978 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.959178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.967880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.980617 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.982112 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:01.982112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:01.983083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] HCTL ('13', '-', '-', 0) found on session 125 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:01.983083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.992966 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:01.993652 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:01.993652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:01.994459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:01.995201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] HCTL ('14', '-', '-', 0) found on session 126 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:01.995201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:02.008973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 125 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:02.008973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:02.016664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 126 and hctl ['14', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:02.086780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.679s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:02.087473 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:23:02.219018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-changed-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:02.219194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Refreshing instance network info cache due to event network-changed-8c7a930e-436e-4b0c-bff9-aa5f89b05d30. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:02.219406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Acquiring lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:02.219585 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Acquired lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:02.219755 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Refreshing network info cache for port 8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:02.320738 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:02.505851 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:02.595844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:23:02.596361 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:23:02.599345 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:02.599345 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:02.695763 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:02.701059 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4e261ef262474d9c74dd8bf2b35d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15233deb57f94a479979c054d80e15cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:23:02.722913 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:03.019028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Searching for a device in session 126 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:03.019541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:03.099355 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:23:03.174650 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:03.205046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:03.205332 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Instance network_info: |[{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:23:03.279844 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Successfully created port: a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:23:03.408305 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updated VIF entry in instance network info cache for port 8c7a930e-436e-4b0c-bff9-aa5f89b05d30. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:03.408642 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating instance_info_cache with network_info: [{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:03.602295 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:23:03.733698 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:23:03.734969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:23:03.735271 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Creating image(s)
May 13 04:23:03.735775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:23:03.736019 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Ensure instance console log exists: /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:23:03.736424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:03.736615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:03.736784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:03.737432 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Start _get_guest_xml network_info=[{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8b8cfba6-f6ed-4e79-a307-ebfccb11ec94', 'attached_at': '', 'detached_at': '', 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'serial': '22150768-1468-48ea-b0f7-0236d97df34e'}, 'disk_bus': 'virtio', 'attachment_id': '4c26ebf9-d3f2-484d-b333-1ea79aeca350', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:03.744985 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:03.746144 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-354434500', uuid='8b8cfba6-f6ed-4e79-a307-ebfccb11ec94'), owner=OwnerMeta(userid='e08e49a99fec460bba306ad25f253e24', username='tempest-TestVolumeBackupRestore-1213215852-project-member', projectid='8b898af52668467f9702dfec1b5d34bb', projectname='tempest-TestVolumeBackupRestore-1213215852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646183.7457407) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:03.753868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:03.753868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:03.754891 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:03.755133 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:03.756837 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:03.757036 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:03.757240 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:03.757568 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:03.757568 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:03.757725 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:03.757855 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:03.758343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:03.758343 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:03.758481 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:03.758608 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:03.758718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:03.776142 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:23:03.776527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:03.776758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:03.791019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Found WWN 3300000001288eeaa for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:03.791382 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:03.791618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== connect_volume: return (4358ms) {'type': 'block', 'scsi_wwn': '3300000001288eeaa', 'path': '/dev/dm-7', 'multipath_id': '3300000001288eeaa'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:03.791768 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001288eeaa', 'path': '/dev/dm-7', 'multipath_id': '3300000001288eeaa'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:03.792497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.016s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:03.792931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:03.805873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:03.806800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:03.807012 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:03.807287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:03.811444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:03.811649 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:03.833294 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Successfully updated port: a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:23:03.833294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:03.833294 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:03.842865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:03.842865 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e] added
May 13 04:23:03.854806 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:03.854806 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:03.854806 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:03.857831 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e] added
May 13 04:23:03.857831 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:03.857831 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:03.857831 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:03.857831 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:03.857831 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:03.857831 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:03.858152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:03.858198 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0512(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:03.858383 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:03.911470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Releasing lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:03.911764 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:03.912355 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing instance network info cache due to event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:03.912577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:03.912700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:03.912920 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:03.919609 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:03.919609 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing instance network info cache due to event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:03.919609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:03.919761 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:03.919761 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:04.300962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1344705829',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:51Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:04.300962 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:04.301511 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:04.302953 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'pci_devices' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:04.335628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:04.415090 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:04.424229 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:04.538525 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:04.613045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:23:04.613350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:23:04.613470 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Creating image(s)
May 13 04:23:04.613887 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:04.614046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:04.628194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:04.628194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "0196e0588ad03d14cf9f9241fcabf223864b222e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:04.631167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "0196e0588ad03d14cf9f9241fcabf223864b222e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:04.692392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.806518 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Object Instance<e44483e5-9065-40b6-a4ea-12eb9109fea5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:04.808776 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <uuid>e44483e5-9065-40b6-a4ea-12eb9109fea5</uuid>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <name>instance-00000033</name>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestShelveInstance-server-683657741</nova:name>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:22:58</nova:creationTime>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:user uuid="f50ff3fb0b4c41dea9c79fe8d54cf794">tempest-TestShelveInstance-592071318-project-member</nova:user>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:project uuid="7e642c6f91a844b89aaaca335f536052">tempest-TestShelveInstance-592071318</nova:project>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         <nova:port uuid="c8d889b7-1f3e-4898-9838-0d40c92de7f5">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="serial">e44483e5-9065-40b6-a4ea-12eb9109fea5</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="uuid">e44483e5-9065-40b6-a4ea-12eb9109fea5</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <alias name="ua-f8925d06-5a4a-4aea-9692-34140d6314a0"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-7"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <serial>f8925d06-5a4a-4aea-9692-34140d6314a0</serial>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:6d:b8:76"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <target dev="tapc8d889b7-1f"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/console.log" append="off"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:04.808776 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Preparing to wait for external event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1344705829',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:51Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.813313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec0b37e5-05cc-5173-80d1-ee2402bebe83', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:04.814020 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.817417 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.821550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:04.825874 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.825874 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8d889b7-1f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:04.826346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8d889b7-1f, col_values=(('qos', UUID('df327e3b-d1f1-447d-b9ba-bf328cc438af')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:04.826504 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8d889b7-1f, col_values=(('external_ids', {'iface-id': 'c8d889b7-1f3e-4898-9838-0d40c92de7f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b8:76', 'vm-uuid': 'e44483e5-9065-40b6-a4ea-12eb9109fea5'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:04.828930 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:04.835061 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:04.836661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.838134 np0000000669 nova-compute[97951]: INFO os_vif [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f')
May 13 04:23:04.856117 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:04.859277 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:04.871488 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:04.871488 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:04.877212 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:04.890222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:04.893224 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:04.893224 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.909546 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.910682 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:04.911291 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.940968 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:04.941532 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:04.973131 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:04.975591 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.50.100,3260]
May 13 04:23:04.975591 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.50.100,3260] successful.
May 13 04:23:04.975591 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:04.999068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:05.006879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.40.100,3260]
May 13 04:23:05.006879 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.40.100,3260] successful.
May 13 04:23:05.006879 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:05.023592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.029814 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.030254 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:05.030254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:05.030687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:05.031727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] HCTL ('15', '-', '-', 0) found on session 127 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:05.031780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:05.050590 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] HCTL ('16', '-', '-', 0) found on session 128 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:05.050590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:05.063969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Searching for a device in session 127 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:05.063969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:05.088617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Searching for a device in session 128 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:05.088617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:05.321251 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updated VIF entry in instance network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:05.322232 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:05.340562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f817d8a5-4d43-408b-a4ce-3647229a6150 req-b53cdaaf-b006-404d-ab64-26e79a18682c service nova] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:05.341006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:05.342375 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:05.469942 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:05.472664 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:05.473509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:05.580240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.part --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:05.580914 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] 91bc70b4-027b-4c11-8520-0391d2b0b0a9 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:23:05.582768 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:23:05.583052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.part /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:05.606444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:23:05.606444 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:23:05.606444 np0000000669 nova-compute[97951]:     <volume>69d8a13a-0c0b-4468-a587-45569dcc2c8e</volume>
May 13 04:23:05.606444 np0000000669 nova-compute[97951]:   </usage>
May 13 04:23:05.606444 np0000000669 nova-compute[97951]: </secret>
May 13 04:23:05.606444 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:23:05.629408 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:05.789505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.part /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.converted" returned: 0 in 0.206s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:05.799360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:05.825551 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:23:05.828833 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7cf50a3b-d9b7-46f7-a9f9-9941395d1011 req-0f57b52f-a6df-41a8-a58d-05fcb69deb4c service nova] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:05.921104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:05.922847 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "0196e0588ad03d14cf9f9241fcabf223864b222e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.291s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:05.922847 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:05.927164 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:05.930377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:05.962835 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:06.034547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:06.034941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "0196e0588ad03d14cf9f9241fcabf223864b222e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:06.036950 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "0196e0588ad03d14cf9f9241fcabf223864b222e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:06.036950 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:06.039192 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:06.039623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:06.138416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Attempting to attach volume 69d8a13a-0c0b-4468-a587-45569dcc2c8e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:23:06.142627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:06.144122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e,backing_fmt=raw /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:06.145000 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <alias name="ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e"/>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <serial>69d8a13a-0c0b-4468-a587-45569dcc2c8e</serial>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="01ea9862-14f6-4930-b935-ac4311507b76"/>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]: </disk>
May 13 04:23:06.145000 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:23:06.226950 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e,backing_fmt=raw /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk 1073741824" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:06.227863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "0196e0588ad03d14cf9f9241fcabf223864b222e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:06.231871 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:06.233928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:06.350155 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json" returned: 0 in 0.118s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:06.352806 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:23:06.353156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:06.400313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:06.401053 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:06.401526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] No VIF found with MAC fa:16:3e:6d:b8:76, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:06.403041 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Using config drive
May 13 04:23:06.475753 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:06.476185 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Cannot resize image /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:23:06.476551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:23:06.476988 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Ensure instance console log exists: /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:23:06.477130 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:06.477227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:06.478432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:06.546151 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:06.848496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Found WWN 33000000009fe2b65 for multipath device dm-10 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:06.848943 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.057s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:06.849164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] <== connect_volume: return (3072ms) {'type': 'block', 'scsi_wwn': '33000000009fe2b65', 'path': '/dev/dm-10', 'multipath_id': '33000000009fe2b65'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:06.849332 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009fe2b65', 'path': '/dev/dm-10', 'multipath_id': '33000000009fe2b65'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:06.914838 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'ec2_ids' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:06.967916 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.048251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:07.048650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance network_info: |[{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:23:07.050809 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start _get_guest_xml network_info=[{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:22:54Z,direct_url=<?>,disk_format='qcow2',id=91bc70b4-027b-4c11-8520-0391d2b0b0a9,min_disk=0,min_ram=0,name='tempest-scenario-img--763057593',owner='15233deb57f94a479979c054d80e15cd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:22:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '91bc70b4-027b-4c11-8520-0391d2b0b0a9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:07.055499 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:07.056919 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='91bc70b4-027b-4c11-8520-0391d2b0b0a9', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1195377242', uuid='36799b72-3299-47fa-b174-6ad9bf4d63c9'), owner=OwnerMeta(userid='9d4e261ef262474d9c74dd8bf2b35d1a', username='tempest-TestMinimumBasicScenario-1268923831-project-member', projectid='15233deb57f94a479979c054d80e15cd', projectname='tempest-TestMinimumBasicScenario-1268923831'), image=ImageMeta(id='91bc70b4-027b-4c11-8520-0391d2b0b0a9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646187.0565104) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:07.062249 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:07.062769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:07.069419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:07.070279 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:07.070908 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:07.071314 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:22:54Z,direct_url=<?>,disk_format='qcow2',id=91bc70b4-027b-4c11-8520-0391d2b0b0a9,min_disk=0,min_ram=0,name='tempest-scenario-img--763057593',owner='15233deb57f94a479979c054d80e15cd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:22:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:07.071528 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:07.071655 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:07.071787 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:07.071888 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:07.072003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:07.072173 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:07.072289 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:07.073743 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:07.073743 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:07.074165 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:07.092141 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:04Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:07.092484 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:07.093469 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:07.094136 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'pci_devices' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:07.356644 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-354434500',display_name='tempest-TestVolumeBackupRestore-server-354434500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebackuprestore-server-354434500',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE74+icGzz6ODUlQoPKQ4ZreC3fwSws8Mo+tfvAxqL1B4T9wC3E8KcKZUQVKQ7LVDvKxPys9wgRE7iTfKH/ARvEm8AVDYUizYF06fgeimEBGK4+lhDtAb+xd2e12TO/RzQ==',key_name='tempest-TestVolumeBackupRestore-1753607131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b898af52668467f9702dfec1b5d34bb',ramdisk_id='',reservation_id='r-zel4tf6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1213215852',owner_user_name='tempest-TestVolumeBackupRestore-1213215852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:01Z,user_data=None,user_id='e08e49a99fec460bba306ad25f253e24',uuid=8b8cfba6-f6ed-4e79-a307-ebfccb11ec94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:07.357108 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converting VIF {"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:07.357559 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:07.357978 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:07.419765 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Object Instance<e44483e5-9065-40b6-a4ea-12eb9109fea5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:07.420019 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'keypairs' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:07.597165 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <uuid>36799b72-3299-47fa-b174-6ad9bf4d63c9</uuid>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <name>instance-00000037</name>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestMinimumBasicScenario-server-1195377242</nova:name>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:07</nova:creationTime>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:image uuid="91bc70b4-027b-4c11-8520-0391d2b0b0a9">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:user uuid="9d4e261ef262474d9c74dd8bf2b35d1a">tempest-TestMinimumBasicScenario-1268923831-project-member</nova:user>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:project uuid="15233deb57f94a479979c054d80e15cd">tempest-TestMinimumBasicScenario-1268923831</nova:project>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="91bc70b4-027b-4c11-8520-0391d2b0b0a9"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         <nova:port uuid="a1871dfc-c535-41da-820b-0aff99f672b1">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="serial">36799b72-3299-47fa-b174-6ad9bf4d63c9</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="uuid">36799b72-3299-47fa-b174-6ad9bf4d63c9</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:5c:5f:f1"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <target dev="tapa1871dfc-c5"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/console.log" append="off"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:07.597165 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:07.600034 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Preparing to wait for external event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:23:07.600034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:07.600034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:07.600034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:07.600689 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:04Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:07.601009 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:07.602228 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:07.602759 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:07.603395 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.604441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.604441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:07.606443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.606443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67b079d9-2f18-5215-b264-a7c02f1c5b5e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.607733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.607733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:07.615095 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.618631 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.618631 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1871dfc-c5, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.618631 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1871dfc-c5, col_values=(('qos', UUID('2c8a7272-ce7f-4d91-a28d-5fbbba2465f8')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.618631 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1871dfc-c5, col_values=(('external_ids', {'iface-id': 'a1871dfc-c535-41da-820b-0aff99f672b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:5f:f1', 'vm-uuid': '36799b72-3299-47fa-b174-6ad9bf4d63c9'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.620820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.620820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:07.633547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.635091 np0000000669 nova-compute[97951]: INFO os_vif [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5')
May 13 04:23:07.866262 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <uuid>8b8cfba6-f6ed-4e79-a307-ebfccb11ec94</uuid>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <name>instance-00000036</name>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBackupRestore-server-354434500</nova:name>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:03</nova:creationTime>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:user uuid="e08e49a99fec460bba306ad25f253e24">tempest-TestVolumeBackupRestore-1213215852-project-member</nova:user>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:project uuid="8b898af52668467f9702dfec1b5d34bb">tempest-TestVolumeBackupRestore-1213215852</nova:project>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         <nova:port uuid="f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="serial">8b8cfba6-f6ed-4e79-a307-ebfccb11ec94</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="uuid">8b8cfba6-f6ed-4e79-a307-ebfccb11ec94</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/disk.config"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <alias name="ua-22150768-1468-48ea-b0f7-0236d97df34e"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-10"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <serial>22150768-1468-48ea-b0f7-0236d97df34e</serial>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:27:ca:39"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <target dev="tapf4827a2b-a8"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/console.log" append="off"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:07.866262 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:07.867993 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Preparing to wait for external event network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:23:07.869637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:07.869909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:07.870089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:07.871068 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-354434500',display_name='tempest-TestVolumeBackupRestore-server-354434500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebackuprestore-server-354434500',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE74+icGzz6ODUlQoPKQ4ZreC3fwSws8Mo+tfvAxqL1B4T9wC3E8KcKZUQVKQ7LVDvKxPys9wgRE7iTfKH/ARvEm8AVDYUizYF06fgeimEBGK4+lhDtAb+xd2e12TO/RzQ==',key_name='tempest-TestVolumeBackupRestore-1753607131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b898af52668467f9702dfec1b5d34bb',ramdisk_id='',reservation_id='r-zel4tf6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1213215852',owner_user_name='tempest-TestVolumeBackupRestore-1213215852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:01Z,user_data=None,user_id='e08e49a99fec460bba306ad25f253e24',uuid=8b8cfba6-f6ed-4e79-a307-ebfccb11ec94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:07.871743 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converting VIF {"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:07.871953 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:07.872276 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:07.874477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.875311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.875311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:07.877509 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.877509 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b74233a4-38c2-596f-a1d0-213a59ce7d03', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.877678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.879036 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:07.889742 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.893705 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.896118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4827a2b-a8, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.896118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4827a2b-a8, col_values=(('qos', UUID('4e045f12-ed91-4a2d-82f1-11b0ee84756e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.896789 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4827a2b-a8, col_values=(('external_ids', {'iface-id': 'f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:ca:39', 'vm-uuid': '8b8cfba6-f6ed-4e79-a307-ebfccb11ec94'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:07.898555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.901896 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:07.916903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:07.918923 np0000000669 nova-compute[97951]: INFO os_vif [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8')
May 13 04:23:07.923331 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Object Instance<e44483e5-9065-40b6-a4ea-12eb9109fea5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:07.927026 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:08.081924 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Creating config drive at /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config
May 13 04:23:08.085268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68ju0664 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:08.149515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68ju0664" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:08.652617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:08.703460 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:08.771984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:08.885954 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:08.886090 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:08.886186 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:08.886302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:95:05:7a, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:08.909020 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fbd40d0-f55f-4ad0-88fb-d4d387d61b2a req-16553eac-efce-49fd-8ca9-3cac3182a6d6 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:08.911349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fbd40d0-f55f-4ad0-88fb-d4d387d61b2a req-16553eac-efce-49fd-8ca9-3cac3182a6d6 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:08.911596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fbd40d0-f55f-4ad0-88fb-d4d387d61b2a req-16553eac-efce-49fd-8ca9-3cac3182a6d6 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:08.911800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3fbd40d0-f55f-4ad0-88fb-d4d387d61b2a req-16553eac-efce-49fd-8ca9-3cac3182a6d6 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:08.911997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3fbd40d0-f55f-4ad0-88fb-d4d387d61b2a req-16553eac-efce-49fd-8ca9-3cac3182a6d6 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Processing event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:23:09.036787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.049977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.056691 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.094183 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.104794 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.171385 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:09.171519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:09.171580 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No VIF found with MAC fa:16:3e:5c:5f:f1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:09.172146 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Using config drive
May 13 04:23:09.446747 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:09.446977 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:09.447038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] No VIF found with MAC fa:16:3e:27:ca:39, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:09.447537 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Using config drive
May 13 04:23:09.632410 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646189.631875, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:09.632713 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Started (Lifecycle Event)
May 13 04:23:09.634497 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:09.640241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:23:09.646500 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance spawned successfully.
May 13 04:23:09.647689 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:09.677850 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:09.829818 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Creating config drive at /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config
May 13 04:23:09.835144 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2hf41et {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:09.884856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:09.909228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2hf41et" returned: 0 in 0.074s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:09.963707 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:10.140495 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:10.144032 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Creating config drive at /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/disk.config
May 13 04:23:10.146638 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:10.150755 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppgywwh5o {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:10.188711 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9c5a6ac-b254-48c1-b271-762af92b5589 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.961s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:10.232935 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppgywwh5o" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:10.478119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-60dc5482-efb5-42d5-b939-48b8904d6a13 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.478s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:10.615442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:10.650102 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646190.6496434, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:10.650261 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Paused (Lifecycle Event)
May 13 04:23:10.661617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:10.886056 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:10.899733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.064173 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:11.065759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:11.066037 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:11.066174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:11.066596 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:11.069688 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d8512000-b702-4edc-8c16-e8db69eb2c74 req-55467e04-f8f4-4919-bb1f-4e49fb64a46f service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received unexpected event network-vif-plugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with vm_state active and task_state None.
May 13 04:23:11.088979 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.098053 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.100840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.126316 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.131421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.154679 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:11.175751 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646191.1735537, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:11.175751 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Resumed (Lifecycle Event)
May 13 04:23:11.187061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.220592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.357277 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.368045 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:11.368273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:11.672300 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.678809 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:11.685251 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:11.709390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:11.872886 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Detaching volume 69d8a13a-0c0b-4468-a587-45569dcc2c8e
May 13 04:23:11.938150 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Attempting to driver detach volume 69d8a13a-0c0b-4468-a587-45569dcc2c8e from mountpoint /dev/vdb
May 13 04:23:11.991163 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '76650676-a82a-4545-8a20-9a44c8ac7419', 'attached_at': '', 'detached_at': '', 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'serial': '69d8a13a-0c0b-4468-a587-45569dcc2c8e'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:23:12.008482 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:23:12.011957 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:23:12.012112 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Attempting to detach device vdb from instance 76650676-a82a-4545-8a20-9a44c8ac7419 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:23:12.012452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <alias name="ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <serial>69d8a13a-0c0b-4468-a587-45569dcc2c8e</serial>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="01ea9862-14f6-4930-b935-ac4311507b76"/>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]: </disk>
May 13 04:23:12.012452 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:23:12.024076 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance 76650676-a82a-4545-8a20-9a44c8ac7419 from the persistent domain config.
May 13 04:23:12.024076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] (1/8): Attempting to detach device vdb with device alias ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e from instance 76650676-a82a-4545-8a20-9a44c8ac7419 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:23:12.024076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <alias name="ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <serial>69d8a13a-0c0b-4468-a587-45569dcc2c8e</serial>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="01ea9862-14f6-4930-b935-ac4311507b76"/>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]: </disk>
May 13 04:23:12.024076 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:23:12.361707 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646192.361064, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:12.362877 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Started (Lifecycle Event)
May 13 04:23:12.491382 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1d50fba-fd18-4669-8ae6-b087c54ba515 req-24ee34c6-197d-4264-940e-8da5f86e7779 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:12.493819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1d50fba-fd18-4669-8ae6-b087c54ba515 req-24ee34c6-197d-4264-940e-8da5f86e7779 service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:12.493966 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1d50fba-fd18-4669-8ae6-b087c54ba515 req-24ee34c6-197d-4264-940e-8da5f86e7779 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:12.494212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1d50fba-fd18-4669-8ae6-b087c54ba515 req-24ee34c6-197d-4264-940e-8da5f86e7779 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:12.497954 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1d50fba-fd18-4669-8ae6-b087c54ba515 req-24ee34c6-197d-4264-940e-8da5f86e7779 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Processing event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:23:12.497954 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:12.508537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:23:12.514104 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance spawned successfully.
May 13 04:23:12.514672 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:23:12.691907 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e for instance 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:23:12.869950 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:12.873264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:12.899150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.025649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:13.136949 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Stashing vm_state: active {{(pid=97951) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 04:23:13.379530 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:23:13.379530 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646193.3785577, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:13.379530 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Paused (Lifecycle Event)
May 13 04:23:13.532548 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Took 8.92 seconds to spawn the instance on the hypervisor.
May 13 04:23:13.532799 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:13.723222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:13.723222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:13.881111 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:13.883692 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646193.8834045, 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:13.883856 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] VM Started (Lifecycle Event)
May 13 04:23:14.045722 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Took 16.08 seconds to build instance.
May 13 04:23:14.181036 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:14.234073 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:23:14.234684 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Claim successful on node np0000000669
May 13 04:23:14.389393 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:14.389393 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646194.388681, 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:14.389393 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] VM Paused (Lifecycle Event)
May 13 04:23:14.548111 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.591s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:14.564033 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:14.564174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:14.564368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:14.564621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:14.564621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:14.564714 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received unexpected event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with vm_state active and task_state None.
May 13 04:23:14.564815 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:14.564930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:14.565062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:14.565167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:14.565263 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Processing event network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:23:14.565538 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] No waiting events found dispatching network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-b95644e3-6bcb-4857-97de-c0feb2a2422d req-92ce6908-6f23-4def-bf6e-4dbdf6ae6635 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received unexpected event network-vif-plugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 for instance with vm_state building and task_state spawning.
May 13 04:23:14.567386 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:14.570617 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:23:14.573826 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Instance spawned successfully.
May 13 04:23:14.575048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:23:14.742888 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating resource usage from migration de0de728-36de-4ea8-b99b-9998a2480420
May 13 04:23:14.884944 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:14.891236 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:14.895292 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646194.8950634, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:14.895457 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Resumed (Lifecycle Event)
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.091725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:15.397890 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:15.406640 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:15.494732 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:15.495027 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:15.601823 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Took 11.87 seconds to spawn the instance on the hypervisor.
May 13 04:23:15.602036 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:15.911012 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646195.910617, 76650676-a82a-4545-8a20-9a44c8ac7419 => ua-69d8a13a-0c0b-4468-a587-45569dcc2c8e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:23:15.912914 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646195.9125917, 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:15.913190 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] VM Resumed (Lifecycle Event)
May 13 04:23:15.918485 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance 76650676-a82a-4545-8a20-9a44c8ac7419 from the live domain config.
May 13 04:23:15.924348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:23:15.925005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:15.925236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:15.926235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:15.927386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69d8a13a-0c0b-4468-a587-45569dcc2c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:23:15.927386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:15.970367 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:15.971963 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:23:15.971963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', '123')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:15.972494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e', '124')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:15.973850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12fba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:23:15.974129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:23:15.974462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flush multipath device 3300000004a25cffd {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:23:15.999792 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:16.014384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:16.065390 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:16.104844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:23:16.105454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:23:16.106869 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:23:16.119145 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Took 20.34 seconds to build instance.
May 13 04:23:16.125021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:23:16.125776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:23:16.144377 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.191407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.40.100,3260]
May 13 04:23:16.191407 np0000000669 nova-compute[97951]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.40.100,3260] successful.
May 13 04:23:16.191407 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.213281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.229548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.280359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.50.100,3260]
May 13 04:23:16.280359 np0000000669 nova-compute[97951]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-69d8a13a-0c0b-4468-a587-45569dcc2c8e, portal: 192.168.50.100,3260] successful.
May 13 04:23:16.280359 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.301712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:16.303514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:16.303655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== disconnect_volume: return (379ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:16.303802 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:23:16.417061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:16.419923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:16.513776 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.791s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:16.513923 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Migrating
May 13 04:23:16.514107 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:23:16.621527 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.857s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:16.884850 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:17.034700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:17.035644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:17.035644 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:17.443812 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:17.444432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:17.539517 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:17.689797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:17.689797 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:17.895199 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f822a6a6-a589-4f27-bd10-2d73f59c6422 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.526s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:17.901014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:17.953849 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:18.063874 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:18.194152 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:23:18.247526 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:18.750142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:18.761283 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:18.761283 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:18.770955 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:23:18.771074 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Claim successful on node np0000000669
May 13 04:23:18.912089 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:18.913717 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing instance network info cache due to event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:18.913967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:18.914338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:18.916990 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:18.970063 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:18.993054 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:18.993296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:18.993557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:18.993747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:18.993947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:18.997944 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Terminating instance
May 13 04:23:19.421348 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:19.503606 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:23:19.531439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.540380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.561936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.570050 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.608804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.788483 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:19.788483 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing instance network info cache due to event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:19.788483 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:19.876149 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999565495999832 future=<Future at 0x7a461c7415b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:19.879227 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.996451302999958 future=<Future at 0x7a461c7415b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:19.879431 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.996207312000024 future=<Future at 0x7a461c7415b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:19.881670 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Instance destroyed successfully.
May 13 04:23:19.883124 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'resources' on Instance uuid 76650676-a82a-4545-8a20-9a44c8ac7419 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:19.895042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:19.967263 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:20.161104 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updated VIF entry in instance network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:20.161447 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:20.197462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:20.197462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:20.197462 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attaching volume 100627b2-b9ef-4b63-b542-edea8b56bf7c to /dev/vdb
May 13 04:23:20.252490 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:20.265451 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Starting migrate_disk_and_power_off {{(pid=97951) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 04:23:20.273929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:23:20.308719 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.317258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:20.347788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.374403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:23:20.374403 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:23:20.383203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:23:20.385136 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fecf:8b3f', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe6d:b876', 'fe80::209c:c2ff:fe09:82a1', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe27:ca39', 'fe80::1406:ecff:fed8:fef0'] 
May 13 04:23:20.385299 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:23:20.385728 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:23:20.386365 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:20.386846 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating existing volume attachment record: 509382c6-2097-4d0b-99e0-dfb3c69ac30b {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:23:20.391015 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1640093144',display_name='tempest-TestEncryptedCinderVolumes-server-1640093144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1640093144',id=52,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAp8p6ZFEb/m8qd8eIHXcPdPE0mAv32LNoTee4BEZx9tQqfgV8mUfOU62i+/kI1/avSYUjTml2GnikRUw2SYKtiKrWHC846rc4iLt0eCE4dah31w/J8dFBTgzFaE6xu+g==',key_name='tempest-keypair-1758183129',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:15Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-zyu7n8km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=76650676-a82a-4545-8a20-9a44c8ac7419,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:20.392228 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "address": "fa:16:3e:95:05:7a", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0607dcc9-c0", "ovs_interfaceid": "0607dcc9-c07a-477c-9a1e-1e3875e914d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:20.393278 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:20.393889 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:20.399658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.400044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0607dcc9-c0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:20.408009 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:20.410222 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.411695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.411873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d200c9f-013b-422a-a08b-2826163630ba) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:20.413526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:20.425044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.430527 np0000000669 nova-compute[97951]: INFO os_vif [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:7a,bridge_name='br-int',has_traffic_filtering=True,id=0607dcc9-c07a-477c-9a1e-1e3875e914d3,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0607dcc9-c0')
May 13 04:23:20.430867 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Deleting instance files /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419_del
May 13 04:23:20.432010 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Deletion of /opt/stack/data/nova/instances/76650676-a82a-4545-8a20-9a44c8ac7419_del complete
May 13 04:23:20.478816 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.491809 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.658555 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999616760999743 future=<Future at 0x7a46482a7320 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:20.664519 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-80757907-3a19-4162-ad2f-76984b7c10f1 req-20c3c1fb-d12e-4ca4-a15b-c1a1b2de353f service nova] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:20.665619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:20.665935 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:20.677023 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance destroyed successfully.
May 13 04:23:20.678300 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:49Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:20.678564 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:20.679676 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:20.679786 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:20.680840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.680931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0faab3e7-86, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:20.689026 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:20.694474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.694474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8a76a64-b4bd-4fc8-9de9-04ed9e58ebf7) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:20.694637 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.695385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:20.699935 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:20.703019 np0000000669 nova-compute[97951]: INFO os_vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86')
May 13 04:23:20.723755 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:20.723959 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:20.940901 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 04:23:20.942212 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:23:20.942412 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:23:20.942505 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:23:20.942759 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:20.993574 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:23:20.993574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:20.995800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:20.995800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:20.995800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:21.011134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:21.011654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:21.011865 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:21.012638 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:21.014769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:21.015492 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:21.031976 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:21.033095 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:21.034001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:21.034223 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:21.034580 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] No waiting events found dispatching network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:21.034749 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:23:21.034891 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:21.035063 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Acquiring lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:21.035271 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:21.035411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "76650676-a82a-4545-8a20-9a44c8ac7419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:21.035548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] No waiting events found dispatching network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:21.035693 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-unplugged-0607dcc9-c07a-477c-9a1e-1e3875e914d3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:23:21.036967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:21.036967 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:21.037128 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:21.037128 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:21.037128 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:21.037128 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:21.040336 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:21.040592 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received unexpected event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with vm_state active and task_state resize_migrating.
May 13 04:23:21.041081 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:21.041081 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:21.041081 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:21.041081 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:21.041219 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:21.041346 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d57bed8e-d62c-4bea-99f3-7f51dc09f2fb req-c5c4551f-2f2c-4ca1-9bd2-26cdf5506888 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received unexpected event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with vm_state active and task_state resize_migrating.
May 13 04:23:21.044313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:21.044313 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:21.058754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c] added
May 13 04:23:21.058754 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:21.058754 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:21.058754 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:21.058754 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:21.058754 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:21.058754 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:21.059792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:21.059792 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0477(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:21.059970 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:21.060254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c] added
May 13 04:23:21.060254 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:21.060254 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:21.060254 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:21.060254 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:21.060254 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:21.060254 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:21.060619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:21.060619 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0456(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:21.060727 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:21.091877 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:21.170402 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:21.229393 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:21.247710 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Detected multiple connections on this host for volume: 47665bd1-526c-4195-a0e3-3a9059be3304, skipping target disconnect.
May 13 04:23:21.255791 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:21.359249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:21.360599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:21.491646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:21.492222 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:21.497990 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:21.621471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:21.621881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk.config /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:21.670513 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:21.674840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk.config /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:21.675093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk.info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:21.730404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "cp -r /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_resize/disk.info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" returned: 0 in 0.055s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:21.737817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.976s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:21.739726 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:23:21.859069 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updated VIF entry in instance network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:21.860135 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:21.869407 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:21.869635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing instance network info cache due to event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:21.869769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:22.060613 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:22.062297 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:22.079524 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:22.079524 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:22.083991 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:22.083991 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.095101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.101464 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.119343 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.122939 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.123424 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.131302 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.131725 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:22.189572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260]
May 13 04:23:22.189572 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260] successful.
May 13 04:23:22.189572 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.203190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.204866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260]
May 13 04:23:22.204866 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260] successful.
May 13 04:23:22.204866 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.220709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.232531 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.233029 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:22.233517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:22.233517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:22.235195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('17', '-', '-', 0) found on session 131 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:22.235368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.245873 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47eb6cbf-ee67-4386-a339-ede33dc48d0b (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:22.246394 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:22.246394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:22.247586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('20', '-', '-', 0) found on session 132 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:22.247690 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:22.254066 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:23:22.254066 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:23:22.254066 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:22.254066 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:22.266353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 131 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:22.266353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:22.266353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 132 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:22.266353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:22.364118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0633d749-1208-4801-b6e8-3922719c4f5a req-0179623c-da56-425b-b134-8799674772c6 service nova] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:22.365728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:22.365728 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:22.372290 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df44e041ec8940e0be0bc8bcd9cc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39efcc41639747809d8c2d84bdee24c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:23:22.624702 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Took 1.68 seconds to deallocate network for instance.
May 13 04:23:22.753725 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:23:22.871532 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:22.903428 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:22.904603 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:22.974764 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Successfully created port: 859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:23:23.012473 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Port 0faab3e7-86ec-4f70-8d30-d950d7dd4592 binding to destination host np0000000669 is already ACTIVE {{(pid=97951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 04:23:23.015605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:23:23.126574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9bc0124-f53a-46ef-86e7-ae73ac8a443f req-d4458eea-8050-4ea1-97f7-1c047f9e718c service nova] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Received event network-vif-deleted-0607dcc9-c07a-477c-9a1e-1e3875e914d3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:23.133294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:23.133506 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:23.257101 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:23:23.279036 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:23.476450 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updated VIF entry in instance network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:23.476903 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:23.539014 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Successfully updated port: 859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:23:23.882908 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:23.883191 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:23.978945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-540c2f0a-a1c5-4278-859d-a9daf0f12ef3 req-81d7a5e0-8ad3-4c98-a83d-418fb7d6aab6 service nova] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:24.023297 np0000000669 nova-compute[97951]: DEBUG nova.compute.rpcapi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 04:23:24.030552 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found WWN 3300000002082c1eb for multipath device dm-14 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:24.030795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:24.030933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000002082c1eb', 'path': '/dev/dm-14', 'multipath_id': '3300000002082c1eb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:24.031051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002082c1eb', 'path': '/dev/dm-14', 'multipath_id': '3300000002082c1eb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:24.034458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:24.034735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:24.034735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:24.040818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:24.040968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquired lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:24.041154 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:24.045256 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:24.088901 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:24.089869 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:23:24.271158 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:23:24.272456 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:23:24.272681 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Creating image(s)
May 13 04:23:24.272964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:24.273105 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:24.273504 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:24.273930 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:24.276263 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:24.277027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:24.372521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:24.373106 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:24.373782 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:24.375466 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:24.380534 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:24.380972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:24.399850 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:24.470717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:24.471062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:24.548041 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk 1073741824" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:24.550362 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attempting to attach volume 100627b2-b9ef-4b63-b542-edea8b56bf7c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:23:24.551162 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:24.551901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:24.573118 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:   <alias name="ua-100627b2-b9ef-4b63-b542-edea8b56bf7c"/>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-14"/>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:   <serial>100627b2-b9ef-4b63-b542-edea8b56bf7c</serial>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]: </disk>
May 13 04:23:24.573118 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:23:24.652895 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:24.657063 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:24.657646 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:23:24.658076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:24.765227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:24.765661 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Cannot resize image /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:23:24.766081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:23:24.766308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Ensure instance console log exists: /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:23:24.766691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:24.766925 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:24.767126 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:24.850699 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:24.896820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:24.912544 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.779s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:24.979112 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deleted allocations for instance 76650676-a82a-4545-8a20-9a44c8ac7419
May 13 04:23:25.014633 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:25.052640 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:25.131728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:25.131865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:25.132005 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:25.206714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-changed-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:25.206834 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing instance network info cache due to event network-changed-859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:25.206967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] Acquiring lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:25.517159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Releasing lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:25.517703 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Instance network_info: |[{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:23:25.518848 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] Acquired lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:25.518848 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing network info cache for port 859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:25.522130 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Start _get_guest_xml network_info=[{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:25.525789 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:25.526924 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1829375926', uuid='4b31b39a-956e-4428-9251-2f50db0eba9b'), owner=OwnerMeta(userid='df44e041ec8940e0be0bc8bcd9cc1f4b', username='tempest-TestStampPattern-2044631915-project-member', projectid='39efcc41639747809d8c2d84bdee24c5', projectname='tempest-TestStampPattern-2044631915'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646205.5265028) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:25.528737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:25.528737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:25.529962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:25.530165 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:25.531308 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:25.531740 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:25.531962 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:25.532085 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:25.532279 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:25.532432 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:25.532574 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:25.532772 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:25.532925 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:25.533087 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:25.533252 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:25.533443 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:25.550435 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1829375926',display_name='tempest-TestStampPattern-server-1829375926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-1829375926',id=56,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-zgn8t1x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:23Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=4b31b39a-956e-4428-9251-2f50db0eba9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:25.550674 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:25.551664 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:25.552423 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:25.635993 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:25.694867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:25.980109 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:25.992290 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-181ab3d5-51f4-41de-8a56-1ef351f228b2 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "76650676-a82a-4545-8a20-9a44c8ac7419" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.999s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:26.023676 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <uuid>4b31b39a-956e-4428-9251-2f50db0eba9b</uuid>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <name>instance-00000038</name>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestStampPattern-server-1829375926</nova:name>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:25</nova:creationTime>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:user uuid="df44e041ec8940e0be0bc8bcd9cc1f4b">tempest-TestStampPattern-2044631915-project-member</nova:user>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:project uuid="39efcc41639747809d8c2d84bdee24c5">tempest-TestStampPattern-2044631915</nova:project>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         <nova:port uuid="859b8100-4be4-4174-80a3-19db57823388">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="serial">4b31b39a-956e-4428-9251-2f50db0eba9b</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="uuid">4b31b39a-956e-4428-9251-2f50db0eba9b</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.config"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:9c:c3:43"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <target dev="tap859b8100-4b"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/console.log" append="off"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:26.057311 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Preparing to wait for external event network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1829375926',display_name='tempest-TestStampPattern-server-1829375926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-1829375926',id=56,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-zgn8t1x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:23Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=4b31b39a-956e-4428-9251-2f50db0eba9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:26.057311 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:26.059755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.059755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:26.059755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:26.061046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.061505 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92ee83d2-80a6-5029-9b07-8f704cc9e1a2', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:26.063119 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.066124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:26.070536 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.070960 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap859b8100-4b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:26.071610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap859b8100-4b, col_values=(('qos', UUID('95a76e05-3fbf-43a0-823b-b2693b1f68c0')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:26.071795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap859b8100-4b, col_values=(('external_ids', {'iface-id': '859b8100-4be4-4174-80a3-19db57823388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:c3:43', 'vm-uuid': '4b31b39a-956e-4428-9251-2f50db0eba9b'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:26.072733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.073949 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:26.079919 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:26.081818 np0000000669 nova-compute[97951]: INFO os_vif [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b')
May 13 04:23:26.084232 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:26.187874 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:26.266050 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:26.266163 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:26.266265 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:26.266398 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No VIF found with MAC fa:16:3e:5c:5f:f1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:26.386289 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:26.562037 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updated VIF entry in instance network info cache for port 859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:26.562437 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:26.591594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:26.597236 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:26.597453 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:26.597630 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:23:26.692040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:27.064750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b98045e7-d221-4b4d-a274-b6f4a314e3c8 req-924b17c1-c712-49e7-96f9-58388961d6e6 service nova] Releasing lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:27.202118 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:27.216863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:23:27.247212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:27.288962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:23:27.290886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:23:27.303102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:23:27.307400 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fecf:8b3f', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe6d:b876', 'fe80::209c:c2ff:fe09:82a1', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe27:ca39', 'fe80::1406:ecff:fed8:fef0'] 
May 13 04:23:27.307400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:23:27.307400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:23:27.307400 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:27.604197 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:27.604846 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:27.605090 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No VIF found with MAC fa:16:3e:9c:c3:43, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:27.605840 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Using config drive
May 13 04:23:27.648405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:27.752222 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:27.755341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:27.850215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-59c8cd7a-39dc-4d23-9ab9-19342425fb39 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.654s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:27.861731 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:27.863191 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:27.869114 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:27.871140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:27.983525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:27.984025 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.093441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.093861 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:28.098718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.132075 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:28.202308 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.202308 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.330025 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.337648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.366792 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Creating config drive at /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.config
May 13 04:23:28.371746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdva1m71h {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.448787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdva1m71h" returned: 0 in 0.077s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.459806 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.460442 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.514878 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Starting finish_migration {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 04:23:28.516735 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance directory exists: not creating {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 04:23:28.518792 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Creating image(s)
May 13 04:23:28.519900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.570097 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.584315 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:28.653467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.133s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.654049 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:23:28.654108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:28.765556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:28.765556 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Cannot resize image /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:23:28.993383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.025645 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.033608 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.165687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.233313 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.271636 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:23:29.272014 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Ensure instance console log exists: /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:23:29.273072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:29.273662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:29.273922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:29.279180 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start _get_guest_xml network_info=[{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '3df1fc73-4ebd-40cf-b61f-2e4d911aa81f', 'attached_at': '2026-05-13T04:23:27.000000', 'detached_at': '', 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'multiattach': True, 'serial': '47665bd1-526c-4195-a0e3-3a9059be3304'}, 'disk_bus': 'virtio', 'attachment_id': 'ed02c68c-f3cd-4b74-9653-96f2296ae0d3', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:29.297067 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:29.302920 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='3df1fc73-4ebd-40cf-b61f-2e4d911aa81f'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646209.3007457) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:29.310841 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a11ee4b7-262a-4693-bb34-cc2df62e1431 req-cd6f89aa-51eb-4d9b-baec-4ac0b26db068 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:29.310841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a11ee4b7-262a-4693-bb34-cc2df62e1431 req-cd6f89aa-51eb-4d9b-baec-4ac0b26db068 service nova] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:29.310841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a11ee4b7-262a-4693-bb34-cc2df62e1431 req-cd6f89aa-51eb-4d9b-baec-4ac0b26db068 service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:29.310841 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a11ee4b7-262a-4693-bb34-cc2df62e1431 req-cd6f89aa-51eb-4d9b-baec-4ac0b26db068 service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:29.310841 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a11ee4b7-262a-4693-bb34-cc2df62e1431 req-cd6f89aa-51eb-4d9b-baec-4ac0b26db068 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Processing event network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:23:29.313234 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:29.314479 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:29.317949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:29.317949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:29.320811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:29.323172 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:29.323519 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:29.324618 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:29.346387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.376233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.378922 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.402791 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.438166 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:29.496840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config --force-share --output=json" returned: 0 in 0.152s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.499209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:29.499533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:29.500484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:29.500968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:23:29.502948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:29.502948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:29.502948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:29.502948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:29.507622 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.519344 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:29.522755 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:29.525367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:29.525367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:29.525367 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:29.525707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:29.525707 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:29.528337 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:29.536651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:29.557914 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:29.557914 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:29.560902 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:29.560902 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:29.573234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:29.583283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.591075 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.591543 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:29.591921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:29.592062 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:29.592877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('19', '0', '0', 0) found on session 116 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:29.593001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:29.607874 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 116 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:29.608467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.608949 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:29.609401 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:29.609747 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.084s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:29.609747 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:29.610861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('18', '0', '0', 0) found on session 115 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:29.611094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:29.628023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 115 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:29.628257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:29.657776 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.658277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.788474 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.789280 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:29.794070 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:29.795656 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:29.846784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:29.847359 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=11350MB free_disk=72.79401397705078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:23:29.847531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:29.849341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:29.898689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:30.155148 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646210.154633, 4b31b39a-956e-4428-9251-2f50db0eba9b => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:30.155881 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:30.156276 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] VM Started (Lifecycle Event)
May 13 04:23:30.161290 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:23:30.168012 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Instance spawned successfully.
May 13 04:23:30.169860 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:23:30.527191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:23:30.660307 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:30.670849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:30.672175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:30.674997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:30.693099 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.694065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.697496 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.697903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.698226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.698616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:30.867569 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Applying migration context for instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f as it has an incoming, in-progress migration de0de728-36de-4ea8-b99b-9998a2480420. Migration status is post-migrating {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 13 04:23:30.868729 np0000000669 nova-compute[97951]: INFO nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating resource usage from migration de0de728-36de-4ea8-b99b-9998a2480420
May 13 04:23:30.924423 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.924620 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.924687 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.924786 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bef8f03b-9d16-489d-904e-04fbce74b056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance c510b785-b650-485f-bb5b-f268ed5742e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e44483e5-9065-40b6-a4ea-12eb9109fea5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Migration de0de728-36de-4ea8-b99b-9998a2480420 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 13 04:23:30.926647 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:30.926927 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4b31b39a-956e-4428-9251-2f50db0eba9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:23:31.074262 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:31.182625 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:23:31.183035 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646211.1825228, 4b31b39a-956e-4428-9251-2f50db0eba9b => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:31.183433 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] VM Paused (Lifecycle Event)
May 13 04:23:31.186000 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:23:31.207838 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Took 6.94 seconds to spawn the instance on the hypervisor.
May 13 04:23:31.208407 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:31.392030 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:31.392347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:31.392536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:31.392686 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:31.392818 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] No waiting events found dispatching network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:31.392940 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-17dfd93c-66cf-40cf-819d-cd6173203781 req-7d376bf9-7f62-4b2c-baea-66ac40564c9d service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received unexpected event network-vif-plugged-859b8100-4be4-4174-80a3-19db57823388 for instance with vm_state active and task_state None.
May 13 04:23:31.431541 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 800b47ef-fd8d-41ee-a361-192302828766 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 04:23:31.431748 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:23:31.431886 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2752MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:23:29 up 37 min,  2 users,  load average: 7.84, 7.98, 5.20\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '5', 'io_workload': '1', 'num_task_resize_finish': '1', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_proj_8b898af52668467f9702dfec1b5d34bb': '1', 'num_proj_15233deb57f94a479979c054d80e15cd': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_39efcc41639747809d8c2d84bdee24c5': '1', 'num_proj_7e642c6f91a844b89aaaca335f536052': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:23:31.444140 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:31.444920 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing instance network info cache due to event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:31.445265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:31.445420 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:31.445595 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:31.686592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:31.690188 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646211.6887178, 4b31b39a-956e-4428-9251-2f50db0eba9b => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:31.690188 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] VM Resumed (Lifecycle Event)
May 13 04:23:31.724752 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Took 13.02 seconds to build instance.
May 13 04:23:31.786484 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:31.948486 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:32.192828 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:32.199338 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:32.217032 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:32.217252 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:32.223758 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.535s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:32.399647 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:32.590601 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updated VIF entry in instance network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:32.590601 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:32.720254 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:33.093429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b7c63d7f-3ffa-439f-86da-c848b38865db req-470df9eb-eea6-4375-9991-6d59b511a9f2 service nova] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:33.230649 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:23:33.230649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.382s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:33.230649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.444s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:33.230649 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:23:33.233938 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:23:33.234097 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Claim successful on node np0000000669
May 13 04:23:33.525839 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:33.526134 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing instance network info cache due to event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:33.526134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:33.526479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:33.526479 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:33.553348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-changed-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:33.553669 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing instance network info cache due to event network-changed-859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:33.553855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] Acquiring lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:33.553996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] Acquired lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:33.554195 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing network info cache for port 859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:34.031860 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:34.057442 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:34.227758 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.228443 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.228532 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.228807 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.229032 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.232341 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.232341 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:23:34.232341 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:23:34.232341 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.85 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:23:34.420751 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:34.450384 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:34.647444 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updated VIF entry in instance network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:34.647696 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:34.665346 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updated VIF entry in instance network info cache for port 859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:34.665346 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:34.876176 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00040318099991054623 future=<Future at 0x7a461c7415b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:34.876335 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:34.876400 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.7816589619997103 future=<Future at 0x7a46482a7320 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:34.876490 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.781566913000006 future=<Future at 0x7a46482a7320 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:34.877665 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Emitting event <LifecycleEvent: 1778646199.8755505, 76650676-a82a-4545-8a20-9a44c8ac7419 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:34.877665 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] VM Stopped (Lifecycle Event)
May 13 04:23:34.900197 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:34.960152 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:34.960363 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:35.151830 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7bda4563-510e-484c-a455-5f756d05eaf1 req-f954e719-a44d-4fb2-8cbe-8eefb878ae2e service nova] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:35.167781 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-83454b6a-0750-4812-8ac2-61d3ebe83b0a req-038a4fc0-2e6a-41a2-a5fc-df03b1568111 service nova] Releasing lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:35.380168 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1d784864-da23-442f-87b7-b9ec81103718 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 76650676-a82a-4545-8a20-9a44c8ac7419] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:35.462775 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:35.658568 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003566690002116957 future=<Future at 0x7a46482a7320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:35.659107 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Emitting event <LifecycleEvent: 1778646200.6571732, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:35.659295 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:35.659445 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Stopped (Lifecycle Event)
May 13 04:23:35.969276 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.739s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:35.969740 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:23:36.076277 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:36.161768 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:36.163502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:36.476369 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:23:36.480347 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:23:36.480347 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:36.480347 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:36.547363 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '434adac2000c4da29488decad2034361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e227d582564c4ef7b5ab8d19583df520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:23:36.667359 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 04:23:36.977202 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:23:37.025897 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Successfully created port: 670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:23:37.295061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:37.295584 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:37.295584 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:37.299019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97951) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 04:23:37.299614 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'flavor' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:37.482472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:23:37.490736 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Successfully updated port: 670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:23:37.538519 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-changed-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:37.538586 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Refreshing instance network info cache due to event network-changed-670b85cb-d621-4858-b259-4f790fff88c8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:37.538689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] Acquiring lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:37.539450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] Acquired lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:37.539604 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Refreshing network info cache for port 670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:37.565639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000caa612da for multipath device dm-11 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:37.565883 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.064s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:37.566064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (8064ms) {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:37.566186 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000caa612da', 'path': '/dev/dm-11', 'multipath_id': '330000000caa612da'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:37.992809 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:38.041385 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:38.072615 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:49Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:38.072917 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:38.073688 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:38.076644 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <uuid>3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</uuid>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <name>instance-00000032</name>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <memory>262144</memory>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:name>multiattach-server-1</nova:name>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:29</nova:creationTime>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.micro" id="84">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:memory>256</nova:memory>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         <nova:port uuid="0faab3e7-86ec-4f70-8d30-d950d7dd4592">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="serial">3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="uuid">3df1fc73-4ebd-40cf-b61f-2e4d911aa81f</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk.config"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-11"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <shareable/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:08:ed:36"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <target dev="tap0faab3e7-86"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/console.log" append="off"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:38.076644 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:38.079721 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:21:49Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000669',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:38.079721 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "vif_mac": "fa:16:3e:08:ed:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:38.079721 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:38.079721 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:38.080294 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.080578 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:38.080788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:38.081974 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.082627 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '043ed3b6-5288-52d8-b148-cbca6aba5f3a', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:38.083813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.085248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:38.090224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.090224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0faab3e7-86, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:38.090224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0faab3e7-86, col_values=(('qos', UUID('e3555a3d-6b7f-43f6-8e24-ce9f2f95a81b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:38.090224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0faab3e7-86, col_values=(('external_ids', {'iface-id': '0faab3e7-86ec-4f70-8d30-d950d7dd4592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ed:36', 'vm-uuid': '3df1fc73-4ebd-40cf-b61f-2e4d911aa81f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:38.092243 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:38.096488 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.097608 np0000000669 nova-compute[97951]: INFO os_vif [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86')
May 13 04:23:38.124688 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:38.250871 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:38.334000 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.336495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.363226 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.364702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.402958 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.404131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.489159 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:23:38.491593 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:23:38.491593 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Creating image(s)
May 13 04:23:38.492593 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:38.492952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:38.494352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:38.494823 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:38.500100 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:38.501397 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:38.610589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:38.613352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:38.613352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:38.613352 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:38.614505 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.620400 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:23:38.622102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:38.650552 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:38.662774 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999226370000088 future=<Future at 0x7a463c75ffe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:38.664870 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance destroyed successfully.
May 13 04:23:38.665461 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'numa_topology' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:38.667625 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.994434690999697 future=<Future at 0x7a463c75ffe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:38.667811 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.994144093999694 future=<Future at 0x7a463c75ffe0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:38.736494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.114s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:38.736939 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:38.756947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4cc96d7a-1ded-478d-ac93-0312b29d1ea7 req-c9f4b1a9-64d2-40df-abdb-f04d84598ead service nova] Releasing lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:38.758866 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquired lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:38.759167 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:38.808264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk 1073741824" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:38.808673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:38.809082 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:38.912436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.103s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:38.913984 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:23:38.914241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:39.018388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:39.018817 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Cannot resize image /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:23:39.019284 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:23:39.019537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Ensure instance console log exists: /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:23:39.019867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:39.020166 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:39.020379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:39.169885 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:39.170480 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:39.330346 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:23:39.505311 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:39.627388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:39.627664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:39.627890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:39.628102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:39.628310 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:39.629965 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received unexpected event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with vm_state stopped and task_state None.
May 13 04:23:39.630291 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:39.630838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:39.630838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:39.630963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:39.631103 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:39.631214 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0ffd3a32-0f19-4462-8ef6-09a27103e570 req-d668a991-4eec-4038-8c52-7ef28c40d97c service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received unexpected event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with vm_state stopped and task_state None.
May 13 04:23:39.659160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:39.659279 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:39.659279 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:39.659448 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:08:ed:36, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:39.659960 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Using config drive
May 13 04:23:39.683101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fa63fe09-06a4-435b-ae9b-6958d6003f68 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.388s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:39.686810 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updating instance_info_cache with network_info: [{"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:39.905099 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.093637 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:23:40.100349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.131525 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.134282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.191020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Releasing lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:40.191408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance network_info: |[{"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:23:40.197822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Start _get_guest_xml network_info=[{"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:40.202407 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:40.203849 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1790166615', uuid='800b47ef-fd8d-41ee-a361-192302828766'), owner=OwnerMeta(userid='434adac2000c4da29488decad2034361', username='tempest-TestEncryptedCinderVolumes-280722860-project-member', projectid='e227d582564c4ef7b5ab8d19583df520', projectname='tempest-TestEncryptedCinderVolumes-280722860'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646220.2034488) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:40.209758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:40.210195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:40.212935 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:40.213164 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:40.214538 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:40.214902 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:40.215108 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:40.215243 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:40.215421 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:40.215553 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:40.215695 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:40.216196 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:40.216458 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:40.216980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:40.216980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:40.216980 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:40.230752 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.236769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790166615',display_name='tempest-TestEncryptedCinderVolumes-server-1790166615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1790166615',id=57,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaM9UcfNrAL9XDPXkR77MSKPqU8riVhGKRxpcYwge5D9640bdM78mj/RpdzFFL7+2DZ3eikc57RIAHNF25TPCCws4pWdTESp0SLwxLrj9Ojqkudi3TrqFZUoVB/UkHEg==',key_name='tempest-keypair-1025909438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-rkkrgtq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=800b47ef-fd8d-41ee-a361-192302828766,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:40.237086 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:40.237732 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:40.238337 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'pci_devices' on Instance uuid 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:40.251222 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.259438 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.316660 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:40.317870 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:40.318061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:40.318176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:40.318285 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:40.318445 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c5fda79a-22a5-4819-85c2-87c9f16f96a6 req-fa2c9570-25fa-4a7d-8866-28aa5e49d05d service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received unexpected event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with vm_state active and task_state resize_finish.
May 13 04:23:40.368475 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.742717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <uuid>800b47ef-fd8d-41ee-a361-192302828766</uuid>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <name>instance-00000039</name>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1790166615</nova:name>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:40</nova:creationTime>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:user uuid="434adac2000c4da29488decad2034361">tempest-TestEncryptedCinderVolumes-280722860-project-member</nova:user>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:project uuid="e227d582564c4ef7b5ab8d19583df520">tempest-TestEncryptedCinderVolumes-280722860</nova:project>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         <nova:port uuid="670b85cb-d621-4858-b259-4f790fff88c8">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="serial">800b47ef-fd8d-41ee-a361-192302828766</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="uuid">800b47ef-fd8d-41ee-a361-192302828766</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.config"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:e3:38:9d"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <target dev="tap670b85cb-d6"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/console.log" append="off"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:40.742717 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Preparing to wait for external event network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790166615',display_name='tempest-TestEncryptedCinderVolumes-server-1790166615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1790166615',id=57,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaM9UcfNrAL9XDPXkR77MSKPqU8riVhGKRxpcYwge5D9640bdM78mj/RpdzFFL7+2DZ3eikc57RIAHNF25TPCCws4pWdTESp0SLwxLrj9Ojqkudi3TrqFZUoVB/UkHEg==',key_name='tempest-keypair-1025909438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-rkkrgtq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=800b47ef-fd8d-41ee-a361-192302828766,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:40.744871 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:40.745196 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:40.745638 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:40.748018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.748018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:40.748018 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:40.749361 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.750272 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff828804-77bb-557d-9b55-0a24558c837a', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:40.750641 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.751484 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:40.759734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.766718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.767089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap670b85cb-d6, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:40.767920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap670b85cb-d6, col_values=(('qos', UUID('f9404c00-5703-4233-9026-ef62bbcf8a03')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:40.768526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap670b85cb-d6, col_values=(('external_ids', {'iface-id': '670b85cb-d621-4858-b259-4f790fff88c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:38:9d', 'vm-uuid': '800b47ef-fd8d-41ee-a361-192302828766'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:40.769495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.771884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:40.782457 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:40.783560 np0000000669 nova-compute[97951]: INFO os_vif [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6')
May 13 04:23:40.997628 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646220.9972262, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:40.997749 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Resumed (Lifecycle Event)
May 13 04:23:40.998793 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:41.000789 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance running successfully.
May 13 04:23:41.003231 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Failed to set time: agent not configured {{(pid=97951) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 04:23:41.003231 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55097185-9448-44c2-969b-bf9bee2cca67 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] finish_migration finished successfully. {{(pid=97951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 04:23:41.218785 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'flavor' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:41.500755 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:41.503194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:41.723448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:41.723702 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:41.723702 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:41.723807 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'info_cache' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:42.006402 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 04:23:42.006785 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646222.006246, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:42.006785 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Started (Lifecycle Event)
May 13 04:23:42.227260 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,info_cache {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:42.301520 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:42.301657 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:42.301701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:e3:38:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:42.302086 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Using config drive
May 13 04:23:42.414296 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:42.415842 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:42.416161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:42.416721 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:42.416721 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:42.416721 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-70f4c226-c5d5-4f6b-a679-f10d645238ea req-45c2047a-58a8-40ae-8999-7115cb2fee34 service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received unexpected event network-vif-plugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with vm_state resized and task_state None.
May 13 04:23:42.509700 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:42.511898 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:42.728737 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:42.744358 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:42.744511 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:42.744621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Going to confirm migration 4 {{(pid=97951) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 04:23:42.808343 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:42.958381 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Creating config drive at /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.config
May 13 04:23:42.964370 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4lk39ugs {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:43.038524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4lk39ugs" returned: 0 in 0.075s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:43.118552 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:43.258347 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:43.298049 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating instance_info_cache with network_info: [{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:43.367155 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:43.369124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:43.369124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:43.369124 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:43.369124 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'info_cache' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:43.577141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.618530 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.624144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.735552 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.801053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-c510b785-b650-485f-bb5b-f268ed5742e3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:43.948542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.957597 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.965602 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:43.997543 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:44.005718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:44.378800 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:44.499253 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Processing event network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:44.501099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:44.501372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:44.501743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:44.501743 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] No waiting events found dispatching network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:44.501743 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-0812e83c-eb96-4da2-a7da-c67e0759b475 req-83c154db-c08a-4316-98e4-db25af51bd4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received unexpected event network-vif-plugged-670b85cb-d621-4858-b259-4f790fff88c8 for instance with vm_state building and task_state spawning.
May 13 04:23:44.536282 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:44.538023 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646224.5375512, 800b47ef-fd8d-41ee-a361-192302828766 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:44.538174 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] VM Started (Lifecycle Event)
May 13 04:23:44.539554 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:23:44.543827 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance spawned successfully.
May 13 04:23:44.544193 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:23:44.746248 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:44.828819 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance destroyed successfully.
May 13 04:23:44.828819 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'numa_topology' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:44.906795 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:44.914370 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:45.042039 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:45.044820 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:45.052680 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.052839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.053153 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.053439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.053747 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.054031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:23:45.330625 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:45.331036 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:45.416375 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:45.416826 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'migration_context' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:45.546980 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:23:45.547189 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646225.54703, 800b47ef-fd8d-41ee-a361-192302828766 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:45.547311 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] VM Paused (Lifecycle Event)
May 13 04:23:45.559238 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Took 7.07 seconds to spawn the instance on the hypervisor.
May 13 04:23:45.559238 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:45.775779 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:45.833790 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:45.836466 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:45.837590 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:45.838216 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:45.839224 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:45.840991 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:45.841335 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7a930e-43, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:45.843281 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:45.845131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:45.847204 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:45.847712 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f5e3fb8-c08d-43f3-bd05-913a8621f4ab) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:45.850337 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:45.852541 np0000000669 nova-compute[97951]: INFO os_vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43')
May 13 04:23:45.854976 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:23:45.855442 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:45.855724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:45.856312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:45.856737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:23:45.856984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:45.899685 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:45.900212 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:23:45.900212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '122')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:45.901369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '121')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:45.902364 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482318a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:23:45.902644 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdd, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:23:45.902903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 3300000000e99ff7b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:23:45.919897 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Object Instance<3df1fc73-4ebd-40cf-b61f-2e4d911aa81f> lazy-loaded attributes: info_cache,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:45.937182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:45.937403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:45.962481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:46.016393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:46.049777 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:46.053272 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646226.0528457, 800b47ef-fd8d-41ee-a361-192302828766 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:46.053478 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] VM Resumed (Lifecycle Event)
May 13 04:23:46.063001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:23:46.063206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:23:46.069093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:23:46.069606 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Took 14.38 seconds to build instance.
May 13 04:23:46.081367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:23:46.081801 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:23:46.096749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.138040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260]
May 13 04:23:46.138040 np0000000669 nova-compute[97951]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260] successful.
May 13 04:23:46.138040 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.162987 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.178263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.221940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260]
May 13 04:23:46.221940 np0000000669 nova-compute[97951]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260] successful.
May 13 04:23:46.221940 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.245704 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.245997 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:46.246141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (390ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:46.246256 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:23:46.251035 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start _get_guest_xml network_info=[{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'c510b785-b650-485f-bb5b-f268ed5742e3', 'attached_at': '', 'detached_at': '', 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'serial': '96d80945-e6ff-4036-8b7b-23cce1da40d5'}, 'disk_bus': 'virtio', 'attachment_id': 'f98df612-ce8d-43ac-b083-90b975789ad2', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:46.253376 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:46.255466 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1205957394', uuid='c510b785-b650-485f-bb5b-f268ed5742e3'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646226.255101) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:46.256682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:46.256887 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:46.258183 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:46.258362 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:46.259187 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:46.259470 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:46.259897 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:46.260003 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:46.260436 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:46.260537 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:46.260633 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:46.260764 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:46.260879 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:46.261483 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:46.261483 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:46.262464 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:46.262835 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'vcpu_model' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:46.556534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:46.563053 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:46.575179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.904s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:46.765566 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:46.776280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:46.886477 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:46.888241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:46.888241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:46.888567 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:46.889066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:23:46.889770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:46.889984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:46.890342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:46.890597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:46.911603 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:46.915219 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:46.916176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:46.916628 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:46.918740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:46.922181 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:46.938380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:46.938380 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.953557 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:46.953557 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.965148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5] added
May 13 04:23:46.965148 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:46.965148 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:46.965148 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:46.965148 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:46.965148 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:46.965148 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.965464 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:46.965601 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0491(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:46.965646 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:46.976986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5] added
May 13 04:23:46.976986 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:46.976986 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:46.976986 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:46.976986 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:46.976986 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:46.976986 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:46.977586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:46.977586 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0583(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:46.977586 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:47.078104 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:47.078104 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing instance network info cache due to event network-changed-c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:47.078104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] Acquiring lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:47.078406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] Acquired lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:47.078406 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Refreshing network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:47.229256 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:47.229463 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:47.582193 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:47.619720 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:47.619886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:47.620038 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:47.620142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:47.620270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:47.623668 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Terminating instance
May 13 04:23:47.733536 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:47.967598 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:47.978814 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:47.988481 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:47.988481 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:48.002264 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:48.002264 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.009008 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:48.012067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.022176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.032250 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.032842 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.045376 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.046305 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:48.050683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-changed-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:48.050878 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Refreshing instance network info cache due to event network-changed-670b85cb-d621-4858-b259-4f790fff88c8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:48.051112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] Acquiring lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:48.051574 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] Acquired lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:48.051759 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Refreshing network info cache for port 670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:48.102921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260]
May 13 04:23:48.102921 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260] successful.
May 13 04:23:48.102921 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.113471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260]
May 13 04:23:48.113471 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260] successful.
May 13 04:23:48.113471 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.116656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.127791 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:23:48.132174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.144358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:48.144358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:48.147511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:48.147511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('9', '-', '-', 0) found on session 135 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:48.147511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:48.165102 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.168545 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:48.168955 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:48.169462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:48.169462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:48.172163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('10', '-', '-', 0) found on session 136 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:48.176694 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.192087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:48.192087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 135 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:48.192087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:48.204265 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.214849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:48.214849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:48.226464 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.265923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.267114 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updated VIF entry in instance network info cache for port c8d889b7-1f3e-4898-9838-0d40c92de7f5. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:48.270441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.272139 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [{"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:48.504515 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.549432 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.556808 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:48.580151 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999577199000214 future=<Future at 0x7a461c7b0080 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:48.596980 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Instance destroyed successfully.
May 13 04:23:48.599174 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lazy-loading 'resources' on Instance uuid e44483e5-9065-40b6-a4ea-12eb9109fea5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:48.769400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.829s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:48.776389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-397bf48a-480b-485c-8081-1c553eb6da33 req-d715a957-a5e3-4408-b5c8-2a8b3df8d156 service nova] Releasing lock "refresh_cache-e44483e5-9065-40b6-a4ea-12eb9109fea5" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:48.916778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:23:48.969846 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.978432 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:48.983569 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.010866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.020689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.056811 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:49.102238 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-683657741',display_name='tempest-TestShelveInstance-server-683657741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testshelveinstance-server-683657741',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7nAvRnQj9V+BRBsiL8wNdE+Q7/iisL31osE7FWHwcXXz6yD+do17RY1dKHTC32CIpRr241qaXyv9AlFU4UugAxUowd+86kbE0PVrvZM9luOAjm3SsVe3FP7NKdLQd+dw==',key_name='tempest-TestShelveInstance-1344705829',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:09Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e642c6f91a844b89aaaca335f536052',ramdisk_id='',reservation_id='r-hxylo151',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-592071318',owner_user_name='tempest-TestShelveInstance-592071318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:10Z,user_data=None,user_id='f50ff3fb0b4c41dea9c79fe8d54cf794',uuid=e44483e5-9065-40b6-a4ea-12eb9109fea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:49.102708 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converting VIF {"id": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "address": "fa:16:3e:6d:b8:76", "network": {"id": "b9b238ed-5b02-46d4-a6a0-8e06d915ae45", "bridge": "br-int", "label": "tempest-TestShelveInstance-1351238829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e642c6f91a844b89aaaca335f536052", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d889b7-1f", "ovs_interfaceid": "c8d889b7-1f3e-4898-9838-0d40c92de7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:49.103429 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:49.103732 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:49.107643 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.107800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8d889b7-1f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:49.108885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.111545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:49.115735 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.115735 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df327e3b-d1f1-447d-b9ba-bf328cc438af) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:49.117993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.120109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:49.124824 np0000000669 nova-compute[97951]: INFO os_vif [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b8:76,bridge_name='br-int',has_traffic_filtering=True,id=c8d889b7-1f3e-4898-9838-0d40c92de7f5,network=Network(b9b238ed-5b02-46d4-a6a0-8e06d915ae45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d889b7-1f')
May 13 04:23:49.128013 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:23:49.128959 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:49.129147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:49.139559 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.146401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.171055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.232056 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updated VIF entry in instance network info cache for port 670b85cb-d621-4858-b259-4f790fff88c8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:49.232377 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updating instance_info_cache with network_info: [{"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:49.402343 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocation for migration de0de728-36de-4ea8-b99b-9998a2480420
May 13 04:23:49.734352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2cd74d15-b29b-42b5-ab5d-1465e161a172 req-8fcaac35-e406-4c86-a408-e9e61378a419 service nova] Releasing lock "refresh_cache-800b47ef-fd8d-41ee-a361-192302828766" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:49.909563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1b0e2a34-433a-40f4-9a07-962c7d73d48f tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.164s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:49.910063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:49.939707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 3300000000e99ff7b for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:49.940100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:49.940416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000000e99ff7b', 'path': '/dev/dm-3', 'multipath_id': '3300000000e99ff7b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:49.940693 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e99ff7b', 'path': '/dev/dm-3', 'multipath_id': '3300000000e99ff7b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:49.941086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.812s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:49.941508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f8925d06-5a4a-4aea-9692-34140d6314a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:23:49.941682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:49.986317 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:49.986853 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:49.987241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:23:49.987241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '125')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:49.988643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0', '126')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:49.989993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c707f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'): ({'sdi'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:23:49.990265 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:23:49.990521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Flush multipath device 3300000001288eeaa {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:23:50.056455 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:50.107426 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:50.139083 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:50.139356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:50.139530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:50.139652 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:50.140307 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:50.140472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:23:50.140516 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:50.140815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Acquiring lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:50.140815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:50.140908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:50.141059 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] No waiting events found dispatching network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:50.141115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-af9bd0b4-e806-4e9a-b5d4-24c19b78a685 req-b2e1beab-b961-4dbd-ad30-46024614df95 service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-unplugged-c8d889b7-1f3e-4898-9838-0d40c92de7f5 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:23:50.157475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:23:50.159388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:23:50.159388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:23:50.175117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:23:50.175343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:23:50.189972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.234388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260]
May 13 04:23:50.234388 np0000000669 nova-compute[97951]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.40.100,3260] successful.
May 13 04:23:50.234388 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.260629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.272962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.305691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260]
May 13 04:23:50.305691 np0000000669 nova-compute[97951]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f8925d06-5a4a-4aea-9692-34140d6314a0, portal: 192.168.50.100,3260] successful.
May 13 04:23:50.305691 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.326420 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:50.326545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:50.326765 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] <== disconnect_volume: return (1198ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:50.326765 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:23:50.327023 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deleting instance files /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5_del
May 13 04:23:50.327525 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deletion of /opt/stack/data/nova/instances/e44483e5-9065-40b6-a4ea-12eb9109fea5_del complete
May 13 04:23:50.456777 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:23:50.456979 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:50.457677 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:50.458515 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:50.846085 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Took 2.72 seconds to destroy the instance on the hypervisor.
May 13 04:23:50.846688 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:23:50.846946 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:23:50.847022 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:23:50.847220 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:50.917941 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:50.961663 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Object Instance<c510b785-b650-485f-bb5b-f268ed5742e3> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:50.963425 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] End _get_guest_xml xml=<domain type="qemu">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <uuid>c510b785-b650-485f-bb5b-f268ed5742e3</uuid>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <name>instance-00000035</name>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-1205957394</nova:name>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:46</nova:creationTime>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         <nova:port uuid="8c7a930e-436e-4b0c-bff9-aa5f89b05d30">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <system>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="serial">c510b785-b650-485f-bb5b-f268ed5742e3</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="uuid">c510b785-b650-485f-bb5b-f268ed5742e3</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </system>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <os>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </os>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <features>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </features>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   <devices>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/disk.config"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <alias name="ua-96d80945-e6ff-4036-8b7b-23cce1da40d5"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <serial>96d80945-e6ff-4036-8b7b-23cce1da40d5</serial>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </disk>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:cf:8b:3f"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <target dev="tap8c7a930e-43"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </interface>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3/console.log" append="off"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </serial>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <video>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </video>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </rng>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:   </devices>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]: </domain>
May 13 04:23:50.963425 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:23:50.969022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:23:50.969448 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:23:50.969646 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:50.970344 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:50.970675 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:23:50.970960 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.971185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:50.971561 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:23:50.972685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.972938 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0254d4a2-8c64-5068-a73a-a361fe54708f', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:50.974876 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.975883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:50.976976 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.979512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.979823 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7a930e-43, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:50.980920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7a930e-43, col_values=(('qos', UUID('6455b9f3-7385-4e5d-b492-4bb5fc809301')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:50.980920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7a930e-43, col_values=(('external_ids', {'iface-id': '8c7a930e-436e-4b0c-bff9-aa5f89b05d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:8b:3f', 'vm-uuid': 'c510b785-b650-485f-bb5b-f268ed5742e3'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:50.981617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.984437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:50.991688 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:50.992547 np0000000669 nova-compute[97951]: INFO os_vif [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43')
May 13 04:23:51.136099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:51.136099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:51.136444 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Rebooting instance
May 13 04:23:51.408694 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a47c65-3e77-4672-b196-5120983af9bb req-a3361b5e-20fa-4122-9110-9fd1c05f728a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Received event network-vif-deleted-c8d889b7-1f3e-4898-9838-0d40c92de7f5 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:51.408855 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-75a47c65-3e77-4672-b196-5120983af9bb req-a3361b5e-20fa-4122-9110-9fd1c05f728a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Neutron deleted interface c8d889b7-1f3e-4898-9838-0d40c92de7f5; detaching it from the instance and deleting it from the info cache
May 13 04:23:51.409010 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-75a47c65-3e77-4672-b196-5120983af9bb req-a3361b5e-20fa-4122-9110-9fd1c05f728a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:51.511170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.539618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.544224 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.578883 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:51.580514 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing instance network info cache due to event network-changed-3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:51.580739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] Acquiring lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:51.580871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] Acquired lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:51.581025 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Refreshing network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:51.643630 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.718807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:51.718807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:51.718807 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:23:51.852022 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:51.857190 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.862097 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.871441 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.895872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.898198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:51.916107 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-75a47c65-3e77-4672-b196-5120983af9bb req-a3361b5e-20fa-4122-9110-9fd1c05f728a service nova] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Detach interface failed, port_id=c8d889b7-1f3e-4898-9838-0d40c92de7f5, reason: Instance e44483e5-9065-40b6-a4ea-12eb9109fea5 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:23:52.084718 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:52.221181 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:52.354347 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Took 1.51 seconds to deallocate network for instance.
May 13 04:23:52.492474 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:52.502041 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:23:52.502949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for c510b785-b650-485f-bb5b-f268ed5742e3 due to new event <LifecycleEvent: 1778646232.5027072, c510b785-b650-485f-bb5b-f268ed5742e3 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:23:52.503112 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646232.5027072, c510b785-b650-485f-bb5b-f268ed5742e3 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:52.503264 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Resumed (Lifecycle Event)
May 13 04:23:52.514796 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance rebooted successfully.
May 13 04:23:52.673732 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:52.708181 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updated VIF entry in instance network info cache for port 3d23fe88-4cef-4e24-9b41-83156fdda4d0. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:52.708494 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [{"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:52.828220 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:52.920113 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Took 0.57 seconds to detach 1 volumes for instance.
May 13 04:23:52.922056 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Deleting volume: f8925d06-5a4a-4aea-9692-34140d6314a0 {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:23:53.010247 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:53.015340 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:53.210860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ab747e72-9cad-44ba-80c1-5505c6318181 req-da225c23-ff7a-41fe-a4a3-97ef584ae3ba service nova] Releasing lock "refresh_cache-bef8f03b-9d16-489d-904e-04fbce74b056" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:53.330417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:53.477128 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:53.477395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:53.477579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:53.477750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:53.477955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:53.478385 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received unexpected event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with vm_state stopped and task_state powering-on.
May 13 04:23:53.478385 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:53.478468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:53.478609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:53.479034 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:53.479264 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:53.480725 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e2f37f70-0beb-42df-9402-7c3faeabcb0a req-39f0a7b1-6af4-4654-b9be-68190192f108 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received unexpected event network-vif-plugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with vm_state stopped and task_state powering-on.
May 13 04:23:53.482500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:53.482656 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:53.522095 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:23:53.522395 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646233.5221703, c510b785-b650-485f-bb5b-f268ed5742e3 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:23:53.522550 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Started (Lifecycle Event)
May 13 04:23:53.664105 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00041993000013462733 future=<Future at 0x7a463c75ffe0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:53.664105 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:53.664105 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.915474174000337 future=<Future at 0x7a461c7b0080 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:53.664105 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.915406960000382 future=<Future at 0x7a461c7b0080 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:53.669456 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:53.669632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing instance network info cache due to event network-changed-0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:53.675542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] Acquiring lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:53.675751 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] Acquired lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:53.676095 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Refreshing network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:53.840086 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:54.024554 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:54.029786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:54.029786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:23:54.029786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:cf:8b:3f, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:23:54.029786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0356ab6d-2440-4f84-aca6-a68f2a9e8c3d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:23:54.031235 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:23:54.184701 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:54.193284 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:23:54.193529 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:23:54.526133 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:54.536225 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 04:23:54.685258 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updated VIF entry in instance network info cache for port 0faab3e7-86ec-4f70-8d30-d950d7dd4592. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:54.685650 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [{"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:54.698618 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:23:54.893992 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.908901 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.928087 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.933113 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.937564 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.968748 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:54.973084 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:55.051380 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-92437e3f-4533-4b50-b6be-242f56ac470d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Get console output
May 13 04:23:55.059624 np0000000669 nova-compute[97951]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 13 04:23:55.187767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1e051247-14a3-4335-a05b-75986bfcea8d req-7b9e4177-7183-4808-82e3-4f123fd7cefc service nova] Releasing lock "refresh_cache-3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:23:55.210042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.727s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:55.216937 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99499827999989 future=<Future at 0x7a463c19e150 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:55.219573 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance destroyed successfully.
May 13 04:23:55.221635 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'resources' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:55.285724 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Deleted allocations for instance e44483e5-9065-40b6-a4ea-12eb9109fea5
May 13 04:23:55.723066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:54Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:55.725252 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:55.725252 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:55.725252 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:55.725575 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:55.725763 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1871dfc-c5, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:55.727661 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:55.729050 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:55.731161 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:55.731312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c8a7272-ce7f-4d91-a28d-5fbbba2465f8) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:55.733269 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:55.734831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:55.742288 np0000000669 nova-compute[97951]: INFO os_vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5')
May 13 04:23:55.742580 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:23:55.742884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:55.743041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:55.743505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:55.743853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:23:55.743978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:23:55.775390 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:55.775964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:55.776173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:55.776389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:55.776594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:55.776767 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received unexpected event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with vm_state active and task_state reboot_started_hard.
May 13 04:23:55.777310 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:55.777310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:55.777310 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:55.778413 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:55.778413 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:55.778413 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-aec80e10-b2b2-45c6-871a-28680c12d7b4 req-73caaf34-c992-4326-91ba-11599beb2e4e service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received unexpected event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with vm_state active and task_state reboot_started_hard.
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:55.793396 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:55.793924 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:55.793924 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:23:55.794346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '132')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:55.795427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '131')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:55.796846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c7482c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'): ({'sdl'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:23:55.797094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Removing multipathed devices sdo, sdl {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:23:55.797377 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flush multipath device 3300000002082c1eb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:23:55.836301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:55.888401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:55.940027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if SCSI volumes sdo, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:23:55.940222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] SCSI volumes sdo, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:23:55.942259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if device paths {'sdo', 'sdl'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:23:55.956465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Device paths {'sdo', 'sdl'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:23:55.956717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:23:55.970117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.004637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260]
May 13 04:23:56.004637 np0000000669 nova-compute[97951]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260] successful.
May 13 04:23:56.004637 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.028919 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.044254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.080153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260]
May 13 04:23:56.080153 np0000000669 nova-compute[97951]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260] successful.
May 13 04:23:56.080153 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.107429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.107673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:56.107849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== disconnect_volume: return (365ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:56.108010 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:23:56.115469 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start _get_guest_xml network_info=[{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91bc70b4-027b-4c11-8520-0391d2b0b0a9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '91bc70b4-027b-4c11-8520-0391d2b0b0a9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, 'status': 'reserved', 'instance': '36799b72-3299-47fa-b174-6ad9bf4d63c9', 'attached_at': '', 'detached_at': '', 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'serial': '100627b2-b9ef-4b63-b542-edea8b56bf7c'}, 'disk_bus': 'virtio', 'attachment_id': '509382c6-2097-4d0b-99e0-dfb3c69ac30b', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:23:56.118388 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:23:56.119889 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='91bc70b4-027b-4c11-8520-0391d2b0b0a9', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1195377242', uuid='36799b72-3299-47fa-b174-6ad9bf4d63c9'), owner=OwnerMeta(userid='9d4e261ef262474d9c74dd8bf2b35d1a', username='tempest-TestMinimumBasicScenario-1268923831-project-member', projectid='15233deb57f94a479979c054d80e15cd', projectname='tempest-TestMinimumBasicScenario-1268923831'), image=ImageMeta(id='91bc70b4-027b-4c11-8520-0391d2b0b0a9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646236.1194615) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:23:56.121620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:23:56.122005 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:23:56.123220 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:23:56.123461 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:23:56.124883 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:23:56.125257 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=91bc70b4-027b-4c11-8520-0391d2b0b0a9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:23:56.125579 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:23:56.125717 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:23:56.125891 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:23:56.126012 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:23:56.126137 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:23:56.126340 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:23:56.126494 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:23:56.126663 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:23:56.126839 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:23:56.127010 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:23:56.127189 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:56.294206 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e08851af-69c7-4453-94d4-70825082b388 tempest-TestShelveInstance-592071318 tempest-TestShelveInstance-592071318-project-member] Lock "e44483e5-9065-40b6-a4ea-12eb9109fea5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.674s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:56.629425 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Object Instance<36799b72-3299-47fa-b174-6ad9bf4d63c9> lazy-loaded attributes: resources,vcpu_model {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:23:56.640249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:23:56.759860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:23:56.760908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:56.761258 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:56.761955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:56.762557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:23:56.762972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:56.763155 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:56.764705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:56.766163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:23:56.786146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:56.786346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:56.788158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:56.788158 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:56.788158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:56.788158 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:56.803945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:56.803945 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.817442 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:23:56.817442 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c] added
May 13 04:23:56.827353 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:56.827353 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:56.827353 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:56.832099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c] added
May 13 04:23:56.832099 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:23:56.832099 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:56.832099 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:56.832099 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:23:56.832099 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:23:56.832099 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:56.832647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:23:56.832845 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:23:56.833010 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:23:57.228944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:57.229362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:57.229362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:57.229362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:57.229482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:57.237188 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Terminating instance
May 13 04:23:57.741837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:23:57.765497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.771700 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.799716 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.804130 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.827477 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:23:57.836351 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:23:57.836984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.837914 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:57.846233 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:57.846233 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:23:57.855795 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:23:57.855795 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.861475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.873693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.887611 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.888588 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.899879 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:57.900204 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:57.953878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260]
May 13 04:23:57.953878 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260] successful.
May 13 04:23:57.953878 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.969503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260]
May 13 04:23:57.969503 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260] successful.
May 13 04:23:57.969503 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.976795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:57.990037 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.003560 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.003886 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:58.004259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:58.004477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:58.006271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('13', '-', '-', 0) found on session 139 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:58.006481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:58.027453 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:58.027453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:23:58.030340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('14', '-', '-', 0) found on session 140 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:23:58.034962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:23:58.034962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 139 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:58.034962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:58.072242 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 140 and hctl ['14', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:58.151479 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999647097999969 future=<Future at 0x7a461c61bfb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:23:58.156529 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Instance destroyed successfully.
May 13 04:23:58.157283 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid c510b785-b650-485f-bb5b-f268ed5742e3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:23:58.171596 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.194837 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:58.196142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:58.196804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:58.196936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:58.197159 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:23:58.197311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f8ae93b-279a-4644-9d1e-17e4d3a6c145 req-671435db-4f4a-4c33-94f3-e6abff141aab service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:23:58.665387 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205957394',display_name='tempest-TestVolumeBootPattern-server-1205957394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1205957394',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNn5xspYXhQFM/VDXprhIbvFw6VHKhtRY6sJK57x+Rdy3F4jA2rSv8WY/XuLwju5OJeF61a0byFovJuSbqoUokLTRDvu9vJnM+kYOqhr7g00RNaJEpP5lPfNKwYEZ1WTg==',key_name='tempest-keypair-1886623598',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-57oio85z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=c510b785-b650-485f-bb5b-f268ed5742e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:23:58.665994 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "address": "fa:16:3e:cf:8b:3f", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a930e-43", "ovs_interfaceid": "8c7a930e-436e-4b0c-bff9-aa5f89b05d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:23:58.666971 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:23:58.666971 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:23:58.668788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.668977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7a930e-43, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:58.671046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.672089 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:58.676719 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:23:58.676884 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing instance network info cache due to event network-changed-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:23:58.677048 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] Acquiring lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:23:58.677140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] Acquired lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:23:58.677300 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Refreshing network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:23:58.681474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.681474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6455b9f3-7385-4e5d-b492-4bb5fc809301) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:23:58.681826 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.682604 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:23:58.683414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:58.686129 np0000000669 nova-compute[97951]: INFO os_vif [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=8c7a930e-436e-4b0c-bff9-aa5f89b05d30,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a930e-43')
May 13 04:23:58.692224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:23:58.693812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:23:58.693960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:23:59.071598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 140 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:23:59.071725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:23:59.180428 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:59.223161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:59.223360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:59.223659 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:23:59.224023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:23:59.224233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:23:59.226381 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Terminating instance
May 13 04:23:59.520584 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:23:59.688686 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updated VIF entry in instance network info cache for port f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:23:59.689213 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [{"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:23:59.730979 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:23:59.751426 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.757550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.773358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.775249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.802246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.818047 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found WWN 3300000002082c1eb for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:23:59.818047 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:23:59.818047 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '3300000002082c1eb', 'path': '/dev/dm-7', 'multipath_id': '3300000002082c1eb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:23:59.818047 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002082c1eb', 'path': '/dev/dm-7', 'multipath_id': '3300000002082c1eb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:23:59.819290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.125s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:23:59.819290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d80945-e6ff-4036-8b7b-23cce1da40d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:23:59.819290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89 (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:23:59.856357 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e39054b-1dcc-4bd9-b4a9-eaba86d4cf89', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:23:59.856357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '135')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:59.858646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5', '136')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:23:59.859681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c748720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:23:59.860014 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sde, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:23:59.860341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 3300000000e99ff7b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:23:59.913733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:23:59.930217 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:23:59.956075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:00.010385 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:00.010385 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:00.011974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:00.028173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:00.028459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:00.043547 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.068288 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:00.069670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:00.069670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:00.069670 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:00.069670 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] No waiting events found dispatching network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:00.069670 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0d96faed-31e6-4be8-b629-98863d2c713c req-195f2198-06cb-48eb-932e-dd35464206c6 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:00.103168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260]
May 13 04:24:00.103168 np0000000669 nova-compute[97951]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.40.100,3260] successful.
May 13 04:24:00.103168 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.108370 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999703001999933 future=<Future at 0x7a4648222240 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:00.108370 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Instance destroyed successfully.
May 13 04:24:00.108632 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lazy-loading 'resources' on Instance uuid 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:00.136226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.152346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.194087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eb06d963-7f1d-424e-a9c9-65548c14728e req-29b0a547-edc3-4f5e-8cac-fcd7d2f50aa9 service nova] Releasing lock "refresh_cache-8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:00.214303 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260]
May 13 04:24:00.214303 np0000000669 nova-compute[97951]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-96d80945-e6ff-4036-8b7b-23cce1da40d5, portal: 192.168.50.100,3260] successful.
May 13 04:24:00.214303 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.246118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.246393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:00.246556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (1552ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:00.246748 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:00.247104 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Deleting instance files /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3_del
May 13 04:24:00.250768 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Deletion of /opt/stack/data/nova/instances/c510b785-b650-485f-bb5b-f268ed5742e3_del complete
May 13 04:24:00.309164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:00.309164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] Acquiring lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:00.309164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:00.309164 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] Lock "c510b785-b650-485f-bb5b-f268ed5742e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:00.309164 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] No waiting events found dispatching network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:00.310019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-40162093-91c7-4e20-ac16-66d6da4a6e72 req-418a1d5b-9c46-4f03-a719-01f68830098f service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-unplugged-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:00.327898 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:54Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:24:00.328121 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:00.328661 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:00.329399 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'pci_devices' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:00.611739 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-354434500',display_name='tempest-TestVolumeBackupRestore-server-354434500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebackuprestore-server-354434500',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE74+icGzz6ODUlQoPKQ4ZreC3fwSws8Mo+tfvAxqL1B4T9wC3E8KcKZUQVKQ7LVDvKxPys9wgRE7iTfKH/ARvEm8AVDYUizYF06fgeimEBGK4+lhDtAb+xd2e12TO/RzQ==',key_name='tempest-TestVolumeBackupRestore-1753607131',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:15Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b898af52668467f9702dfec1b5d34bb',ramdisk_id='',reservation_id='r-zel4tf6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1213215852',owner_user_name='tempest-TestVolumeBackupRestore-1213215852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:16Z,user_data=None,user_id='e08e49a99fec460bba306ad25f253e24',uuid=8b8cfba6-f6ed-4e79-a307-ebfccb11ec94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:24:00.611969 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converting VIF {"id": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "address": "fa:16:3e:27:ca:39", "network": {"id": "447b03ef-715d-464a-b9d7-29b76e6f842b", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-465506816-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b898af52668467f9702dfec1b5d34bb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4827a2b-a8", "ovs_interfaceid": "f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:00.613364 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:00.613625 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:24:00.614562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.614835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4827a2b-a8, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:00.619555 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.620524 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:00.621177 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.621353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e045f12-ed91-4a2d-82f1-11b0ee84756e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:00.622029 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.622483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:00.623259 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.629547 np0000000669 nova-compute[97951]: INFO os_vif [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1,network=Network(447b03ef-715d-464a-b9d7-29b76e6f842b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4827a2b-a8')
May 13 04:24:00.631410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:00.631722 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:00.631844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:00.632386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:00.632651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22150768-1468-48ea-b0f7-0236d97df34e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:00.632838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:00.676992 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '128')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:00.676992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e', '127')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:00.677906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c1151c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:00.677906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:00.677906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Flush multipath device 33000000009fe2b65 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:00.736614 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:00.754281 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Took 3.01 seconds to destroy the instance on the hypervisor.
May 13 04:24:00.754965 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:00.755259 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:00.755259 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:00.755580 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:00.809420 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:00.833465 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Object Instance<36799b72-3299-47fa-b174-6ad9bf4d63c9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:24:00.835206 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] End _get_guest_xml xml=<domain type="qemu">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <uuid>36799b72-3299-47fa-b174-6ad9bf4d63c9</uuid>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <name>instance-00000037</name>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestMinimumBasicScenario-server-1195377242</nova:name>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:23:56</nova:creationTime>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:image uuid="91bc70b4-027b-4c11-8520-0391d2b0b0a9">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:user uuid="9d4e261ef262474d9c74dd8bf2b35d1a">tempest-TestMinimumBasicScenario-1268923831-project-member</nova:user>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:project uuid="15233deb57f94a479979c054d80e15cd">tempest-TestMinimumBasicScenario-1268923831</nova:project>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="91bc70b4-027b-4c11-8520-0391d2b0b0a9"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         <nova:port uuid="a1871dfc-c535-41da-820b-0aff99f672b1">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <system>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="serial">36799b72-3299-47fa-b174-6ad9bf4d63c9</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="uuid">36799b72-3299-47fa-b174-6ad9bf4d63c9</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </system>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <os>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </os>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <features>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </features>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   <devices>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk.config"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <alias name="ua-100627b2-b9ef-4b63-b542-edea8b56bf7c"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-7"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <serial>100627b2-b9ef-4b63-b542-edea8b56bf7c</serial>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:5c:5f:f1"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <target dev="tapa1871dfc-c5"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </interface>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/console.log" append="off"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </serial>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <video>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </video>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </rng>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:   </devices>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]: </domain>
May 13 04:24:00.835206 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:24:00.839972 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:00.861597 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:00.871467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:00.873968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:00.873968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:00.887519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:00.888019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:00.907549 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:00.910171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.955004 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.40.100,3260]
May 13 04:24:00.955004 np0000000669 nova-compute[97951]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.40.100,3260] successful.
May 13 04:24:00.955004 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:00.965483 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:00.966208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:00.985952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:01.003961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:01.045681 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.50.100,3260]
May 13 04:24:01.045681 np0000000669 nova-compute[97951]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-22150768-1468-48ea-b0f7-0236d97df34e, portal: 192.168.50.100,3260] successful.
May 13 04:24:01.045681 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:01.069404 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:01.069832 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:01.069984 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] <== disconnect_volume: return (438ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:01.070174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:01.070904 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Deleting instance files /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94_del
May 13 04:24:01.072061 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Deletion of /opt/stack/data/nova/instances/8b8cfba6-f6ed-4e79-a307-ebfccb11ec94_del complete
May 13 04:24:01.096121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:01.096908 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:24:01.097973 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'trusted_certs' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:01.592450 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Took 1.86 seconds to destroy the instance on the hypervisor.
May 13 04:24:01.593238 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:01.593603 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:01.593705 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:01.594818 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:01.602188 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Object Instance<36799b72-3299-47fa-b174-6ad9bf4d63c9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:24:01.602390 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:01.703815 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:01.733406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0196e0588ad03d14cf9f9241fcabf223864b222e --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:01.733850 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:24:01.734234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:01.838360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:01.839564 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Cannot resize image /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:24:01.839564 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'migration_context' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:01.905491 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:02.086496 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ae6aa6ea-5495-4881-a33b-64ec2e80ecd5 req-89b5d475-b674-419b-b31b-c44823d7cc02 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-deleted-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:02.086923 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ae6aa6ea-5495-4881-a33b-64ec2e80ecd5 req-89b5d475-b674-419b-b31b-c44823d7cc02 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Neutron deleted interface f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1; detaching it from the instance and deleting it from the info cache
May 13 04:24:02.087077 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ae6aa6ea-5495-4881-a33b-64ec2e80ecd5 req-89b5d475-b674-419b-b31b-c44823d7cc02 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:02.135635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:02.136418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] Acquiring lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:02.136609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:02.136778 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:02.136974 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] No waiting events found dispatching network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:02.137156 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b472f95d-e79d-4a77-93fa-871f54c0b2d4 req-4395d1dc-32bb-460e-b879-1cbfe827f1ed service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Received event network-vif-unplugged-f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:02.342810 np0000000669 nova-compute[97951]: DEBUG nova.objects.base [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Object Instance<36799b72-3299-47fa-b174-6ad9bf4d63c9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97951) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 04:24:02.343748 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:23:54Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:24:02.343966 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:02.344848 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:02.345156 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:24:02.345662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.346034 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:02.346433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:24:02.347295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.347511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67b079d9-2f18-5215-b264-a7c02f1c5b5e', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:02.348444 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.349874 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:02.352268 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.355177 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.355383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1871dfc-c5, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:02.358791 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1871dfc-c5, col_values=(('qos', UUID('bd76c4be-1f8c-4a6a-b2ef-b678ae7c3ad6')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:02.359040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1871dfc-c5, col_values=(('external_ids', {'iface-id': 'a1871dfc-c535-41da-820b-0aff99f672b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:5f:f1', 'vm-uuid': '36799b72-3299-47fa-b174-6ad9bf4d63c9'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:02.360305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.362252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:02.370380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.371131 np0000000669 nova-compute[97951]: INFO os_vif [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5')
May 13 04:24:02.380589 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a18f78dd-2f01-44d0-9a38-e4c74b47d4b5 req-3c11a751-0700-4450-9b8c-a8b8115b3a13 service nova] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Received event network-vif-deleted-8c7a930e-436e-4b0c-bff9-aa5f89b05d30 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:02.410137 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Took 1.65 seconds to deallocate network for instance.
May 13 04:24:02.518165 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:02.591835 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ae6aa6ea-5495-4881-a33b-64ec2e80ecd5 req-89b5d475-b674-419b-b31b-c44823d7cc02 service nova] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Detach interface failed, port_id=f4827a2b-a86d-4cba-b7f5-9a0aeb3706b1, reason: Instance 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:24:02.870563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.902197 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:02.966519 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:24:03.023953 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Took 1.43 seconds to deallocate network for instance.
May 13 04:24:03.032371 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:03.260659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:03.271813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:03.295429 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:03.476591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:03.476883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:03.578492 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004054070000165666 future=<Future at 0x7a461c7b0080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:03.578890 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:03.579077 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.632868435000091 future=<Future at 0x7a463c19e150 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:03.579752 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646228.5779676, e44483e5-9065-40b6-a4ea-12eb9109fea5 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:03.579881 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] VM Stopped (Lifecycle Event)
May 13 04:24:03.582760 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.629153073999987 future=<Future at 0x7a463c19e150 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:03.587367 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:24:03.965815 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for 36799b72-3299-47fa-b174-6ad9bf4d63c9 due to new event <LifecycleEvent: 1778646243.9634078, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:24:03.965815 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646243.9634078, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:03.965815 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Resumed (Lifecycle Event)
May 13 04:24:03.967682 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance event wait completed in 0 seconds for  {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:24:03.970196 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance rebooted successfully.
May 13 04:24:04.085107 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-529601f0-721d-4ced-80fd-5027c441e33c tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: e44483e5-9065-40b6-a4ea-12eb9109fea5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:04.093910 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:04.158288 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:04.158566 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:04.236704 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:04.236853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:04.237003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:04.237115 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:04.237312 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:04.237496 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received unexpected event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with vm_state active and task_state reboot_started_hard.
May 13 04:24:04.237665 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:04.237851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:04.238018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:04.238123 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:04.238225 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:04.238351 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e72ca18c-e7a1-410c-8492-73b663944c6d req-61533262-4b7b-47f2-b2fd-7dbc5b95bd39 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received unexpected event network-vif-plugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with vm_state active and task_state reboot_started_hard.
May 13 04:24:04.469048 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:04.480640 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:04.661347 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:04.930776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:04.983489 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 13 04:24:04.984028 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646244.9835644, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:04.984028 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Started (Lifecycle Event)
May 13 04:24:05.173993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.697s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:05.175008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.081s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:05.244974 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance c510b785-b650-485f-bb5b-f268ed5742e3
May 13 04:24:05.486217 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:05.489765 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:05.495981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:05.497553 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:05.497553 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:05.497553 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No VIF found with MAC fa:16:3e:5c:5f:f1, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:05.497930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:05.770988 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:05.771196 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:05.997934 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 13 04:24:06.010889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-99e0ea08-8f8b-434d-b1f7-023e80b223fc tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 14.874s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:06.254359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-f1408b17-4ea5-4cd3-8a15-6ebfc6e0af6e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "c510b785-b650-485f-bb5b-f268ed5742e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.025s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:06.273611 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:06.782678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.607s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:06.885700 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Deleted allocations for instance 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94
May 13 04:24:07.361839 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:07.896714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-47a7e8b5-0b1a-4114-91f7-7d98d4c527b5 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Lock "8b8cfba6-f6ed-4e79-a307-ebfccb11ec94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.673s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:09.950683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:10.214349 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003378579999662179 future=<Future at 0x7a463c19e150 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:10.214349 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:10.214349 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.9373944989997653 future=<Future at 0x7a461c61bfb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:10.214349 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.9373115859998506 future=<Future at 0x7a461c61bfb0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:10.235481 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:10.235726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:10.739376 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:11.378749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:11.746448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:11.967417 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:11.968122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:12.363960 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:12.433449 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:12.433991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:12.472353 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Detaching volume 47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:24:12.545891 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Attempting to driver detach volume 47665bd1-526c-4195-a0e3-3a9059be3304 from mountpoint /dev/vdb
May 13 04:24:12.561831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:12.565382 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:12.565568 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Attempting to detach device vdb from instance bef8f03b-9d16-489d-904e-04fbce74b056 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:24:12.565876 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:12.565876 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:12.583686 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance bef8f03b-9d16-489d-904e-04fbce74b056 from the persistent domain config.
May 13 04:24:12.584046 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] (1/8): Attempting to detach device vdb with device alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 from instance bef8f03b-9d16-489d-904e-04fbce74b056 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:24:12.584277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:12.584277 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:12.935514 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:24:12.997446 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:12.997625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:12.997875 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Attaching volume 05ec875f-f541-41cd-99fa-fd7c1125c3ad to /dev/vdb
May 13 04:24:13.046863 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:13.062788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:24:13.091549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:13.152843 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.002566482000020187 future=<Future at 0x7a461c61bfb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:13.156350 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:13.156350 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.9516623019999315 future=<Future at 0x7a4648222240 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:13.156350 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.9514704279999933 future=<Future at 0x7a4648222240 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:13.156350 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Emitting event <LifecycleEvent: 1778646238.149768, c510b785-b650-485f-bb5b-f268ed5742e3 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:13.156350 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] VM Stopped (Lifecycle Event)
May 13 04:24:13.160625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:24:13.161392 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:24:13.173615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:24:13.175390 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fee3:389d', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac'] 
May 13 04:24:13.177015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:24:13.177015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:24:13.177015 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:13.177015 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating existing volume attachment record: 8181371f-ac46-46e5-8a4e-b04c7334a171 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:24:13.193640 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646253.1930883, bef8f03b-9d16-489d-904e-04fbce74b056 => ua-47665bd1-526c-4195-a0e3-3a9059be3304> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:24:13.196276 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 for instance bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:24:13.200199 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance bef8f03b-9d16-489d-904e-04fbce74b056 from the live domain config.
May 13 04:24:13.381703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:13.507761 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:13.508134 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:13.512266 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:24:13.512475 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Claim successful on node np0000000669
May 13 04:24:13.544952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:13.660554 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-32cfb9d5-8b5f-4780-8f5b-56964fea492b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: c510b785-b650-485f-bb5b-f268ed5742e3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:13.747745 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Detected multiple connections on this host for volume: 47665bd1-526c-4195-a0e3-3a9059be3304, skipping target disconnect.
May 13 04:24:13.750169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:24:13.750169 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:13.750745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:13.752452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:13.752977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:24:13.769519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:13.770437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:13.770437 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:13.771140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:13.771751 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:13.771960 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:13.792554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:13.792554 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:13.793280 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:13.793280 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:13.809945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad] added
May 13 04:24:13.809945 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:13.809945 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:13.809945 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:13.809945 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:13.809945 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:13.809945 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:13.810263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:13.810263 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:13.810439 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:13.819687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad] added
May 13 04:24:13.819687 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:13.819687 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:13.819687 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:13.819687 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:13.819687 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:13.819687 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:13.819964 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:13.819964 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.048(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:13.820350 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:14.331627 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:14.810966 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:14.820842 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:14.831782 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:14.831782 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:14.848532 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:14.848532 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.855705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.864385 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.883405 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.891114 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:14.931507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.40.100,3260]
May 13 04:24:14.931507 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.40.100,3260] successful.
May 13 04:24:14.931507 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.943602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.50.100,3260]
May 13 04:24:14.943602 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.50.100,3260] successful.
May 13 04:24:14.943602 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.950412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.956241 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:14.958707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.968852 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.969117 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:14.969534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:14.969534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:14.971677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] HCTL ('9', '-', '-', 0) found on session 141 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:14.971841 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:14.979398 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] HCTL ('10', '-', '-', 0) found on session 142 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:14.979398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:14.991432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching for a device in session 141 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:14.991432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:15.006298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:15.006298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:15.106160 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000451199000053748 future=<Future at 0x7a4648222240 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:15.106160 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:15.106963 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Emitting event <LifecycleEvent: 1778646240.105499, 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:15.107568 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] VM Stopped (Lifecycle Event)
May 13 04:24:15.123850 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:15.125112 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:15.344173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d6762265-4b13-4357-bbfc-f3dc58198f15 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.376s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:15.405153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:15.405153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:15.617900 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 8b8cfba6-f6ed-4e79-a307-ebfccb11ec94] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:15.627906 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:15.772746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:24:15.857200 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:15.906662 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Detaching volume 47665bd1-526c-4195-a0e3-3a9059be3304
May 13 04:24:15.963450 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Attempting to driver detach volume 47665bd1-526c-4195-a0e3-3a9059be3304 from mountpoint /dev/vdb
May 13 04:24:15.969949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:15.973557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found disk vdb by alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:15.973557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Attempting to detach device vdb from instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:24:15.973557 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:15.973557 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:15.980401 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f from the persistent domain config.
May 13 04:24:15.981241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] (1/8): Attempting to detach device vdb with device alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 from instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:24:15.981241 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <alias name="ua-47665bd1-526c-4195-a0e3-3a9059be3304"/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-11"/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <serial>47665bd1-526c-4195-a0e3-3a9059be3304</serial>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:15.981241 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:16.137279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.627s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:16.137279 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:24:16.642621 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:24:16.642838 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:24:16.643177 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:16.643642 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:16.728702 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:24:16.798554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found WWN 330000000b5ae7ca4 for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:24:16.798792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:16.798943 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000b5ae7ca4', 'path': '/dev/dm-3', 'multipath_id': '330000000b5ae7ca4'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:16.799051 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b5ae7ca4', 'path': '/dev/dm-3', 'multipath_id': '330000000b5ae7ca4'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:24:16.804959 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:17.150079 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:24:17.168504 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Successfully created port: 2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:24:17.307885 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Attempting to attach volume 05ec875f-f541-41cd-99fa-fd7c1125c3ad with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:24:17.309445 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:   <alias name="ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad"/>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:   <serial>05ec875f-f541-41cd-99fa-fd7c1125c3ad</serial>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:17.309445 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:24:17.364905 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:17.655574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:24:17.778684 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Successfully updated port: 2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:24:17.864069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-changed-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:17.864069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Refreshing instance network info cache due to event network-changed-2aacb877-832e-4772-a6f0-2621ad37a6f3. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:17.864069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] Acquiring lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:17.864069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] Acquired lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:17.864677 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Refreshing network info cache for port 2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:18.163429 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Booting with volume snapshot 22730b74-483f-4b3d-804f-2300f7754b91 at /dev/vda
May 13 04:24:18.280875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:18.368132 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:18.453461 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:18.627452 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:18.806345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:18.989614 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:18.989786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:18.989926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:18.990091 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No VIF found with MAC fa:16:3e:9c:c3:43, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:19.129282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cdf06737-7fc6-4b52-bee1-5db4ec63ee6a req-161d1408-4048-4c65-8aaa-20f7c396c11e service nova] Releasing lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:19.130727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:19.130727 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:24:19.359911 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646259.3593516, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => ua-47665bd1-526c-4195-a0e3-3a9059be3304> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:24:19.361096 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-47665bd1-526c-4195-a0e3-3a9059be3304 for instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:24:19.364387 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully detached device vdb from instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f from the live domain config.
May 13 04:24:19.408104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:19.408509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:19.408701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:19.701512 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:19.842945 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:19.958120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:19.968025 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Updating instance_info_cache with network_info: [{"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:20.469876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-05623762-9272-41d8-97a9-1011e80eaa0e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:20.470540 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance network_info: |[{"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:24:20.547577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51616be3-5486-44d7-8372-1240f6665d09 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.550s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:20.662735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.254s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:20.663085 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47665bd1-526c-4195-a0e3-3a9059be3304', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:20.663222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:20.685844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:20.702274 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304 (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:20.702643 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:20.702643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:20.702878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '116')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:20.703991 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304', '115')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:20.705452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b5440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'): ({'sdm'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:20.705667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Removing multipathed devices sdn, sdm {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:20.705851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flush multipath device 330000000caa612da {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:20.740994 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:20.805178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:20.855191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:20.855607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:20.857632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:20.871429 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:20.871778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:20.884640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:20.926466 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.40.100,3260]
May 13 04:24:20.926466 np0000000669 nova-compute[97951]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.40.100,3260] successful.
May 13 04:24:20.926466 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:20.950387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:20.964822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:21.009977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.50.100,3260]
May 13 04:24:21.009977 np0000000669 nova-compute[97951]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-47665bd1-526c-4195-a0e3-3a9059be3304, portal: 192.168.50.100,3260] successful.
May 13 04:24:21.009977 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:21.030565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:21.031938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:21.031938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== disconnect_volume: return (1622ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:21.031938 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:21.085381 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:21.085381 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 04:24:21.587018 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:24:21.608606 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'flavor' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:21.612136 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:21.633038 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:24:21.659044 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:21.705476 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:24:21.705925 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:24:21.714878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:24:21.716189 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fee3:389d', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac'] 
May 13 04:24:21.716310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:24:21.716456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:24:21.716700 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:21.717068 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Updating existing volume attachment record: 82713f1a-d8d8-4c60-9a21-8c61969f7ac8 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:24:22.366182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:22.637717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9053e7f2-fbee-4580-a8b6-02357624a3dd tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.233s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:23.841738 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:24:23.843585 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:24:23.843585 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Creating image(s)
May 13 04:24:23.843969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:24:23.844216 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Ensure instance console log exists: /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:24:23.844361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:23.844593 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:23.844766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:23.845378 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Start _get_guest_xml network_info=[{"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '05623762-9272-41d8-97a9-1011e80eaa0e', 'attached_at': '', 'detached_at': '', 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'serial': '940b1c4f-714f-4a08-bb68-b1f34ab06c08'}, 'disk_bus': 'virtio', 'attachment_id': '82713f1a-d8d8-4c60-9a21-8c61969f7ac8', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:24:23.853850 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:24:23.854946 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2134606091', uuid='05623762-9272-41d8-97a9-1011e80eaa0e'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646263.8544931) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:24:23.856920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:24:23.857559 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:24:23.858722 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:24:23.858928 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:24:23.860184 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:24:23.861219 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:24:23.861727 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:24:23.862603 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:24:23.862603 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:24:23.862603 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:24:23.862603 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:24:23.862855 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:24:23.863078 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:24:23.863205 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:24:23.863437 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:24:23.863625 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:24:23.882805 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:24:23.883229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:23.883961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:23.883961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:23.884141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:24:23.897740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:23.898144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:23.898405 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:23.899228 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:23.899639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:23.899845 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:23.915672 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:23.915672 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:23.919563 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:23.919563 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:23.929822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08] added
May 13 04:24:23.929822 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:23.929822 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:23.929822 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:23.929822 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:23.929822 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:23.929822 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:23.930666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:23.930666 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:23.930666 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08] added
May 13 04:24:23.942193 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:23.942193 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:23.942193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:23.942583 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:23.942583 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:24.401191 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:24.401375 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:24.780184 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:24.780392 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:24.905251 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:24.931057 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:24.942081 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:24.942081 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:24.945179 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:24.955042 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:24.960517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:24.963642 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:24.963642 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:24.971035 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:24.971234 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:24.978487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.002176 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.002414 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:25.014899 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.40.100,3260]
May 13 04:24:25.014899 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.40.100,3260] successful.
May 13 04:24:25.014899 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:25.027653 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:25.046224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.50.100,3260]
May 13 04:24:25.046224 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.50.100,3260] successful.
May 13 04:24:25.046224 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.048313 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.048768 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:25.049082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:25.049082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:25.050151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('12', '-', '-', 0) found on session 144 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:25.050307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:25.071427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:25.071427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 144 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:25.071427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.086137 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:25.086503 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:25.086777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:25.086777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:25.087702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('15', '-', '-', 0) found on session 145 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:25.087825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:25.103067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 145 and hctl ['15', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:25.264677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:25.264677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:25.284768 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Detaching volume 05ec875f-f541-41cd-99fa-fd7c1125c3ad
May 13 04:24:25.335347 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Attempting to driver detach volume 05ec875f-f541-41cd-99fa-fd7c1125c3ad from mountpoint /dev/vdb
May 13 04:24:25.338389 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found disk vdb by alias ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:25.343816 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found disk vdb by alias ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:25.344196 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Attempting to detach device vdb from instance 4b31b39a-956e-4428-9251-2f50db0eba9b from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:24:25.344506 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <alias name="ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad"/>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <serial>05ec875f-f541-41cd-99fa-fd7c1125c3ad</serial>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:25.344506 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:25.356716 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully detached device vdb from instance 4b31b39a-956e-4428-9251-2f50db0eba9b from the persistent domain config.
May 13 04:24:25.356716 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] (1/8): Attempting to detach device vdb with device alias ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad from instance 4b31b39a-956e-4428-9251-2f50db0eba9b from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:24:25.357285 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <alias name="ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad"/>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-3"/>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <serial>05ec875f-f541-41cd-99fa-fd7c1125c3ad</serial>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:25.357285 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:25.767047 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:24:25.877611 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646265.8772068, 4b31b39a-956e-4428-9251-2f50db0eba9b => ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:24:25.878866 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-05ec875f-f541-41cd-99fa-fd7c1125c3ad for instance 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:24:25.880990 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully detached device vdb from instance 4b31b39a-956e-4428-9251-2f50db0eba9b from the live domain config.
May 13 04:24:25.882033 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:25.882298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:25.882446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:25.910984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:26.103174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 145 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:26.103431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:26.325886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:26.326094 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:26.328894 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:24:26.329020 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Claim successful on node np0000000669
May 13 04:24:26.586678 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:26.587056 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:24:26.917903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 330000000ed995381 for multipath device dm-4 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:24:26.917903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:26.917903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000ed995381', 'path': '/dev/dm-4', 'multipath_id': '330000000ed995381'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:26.918599 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed995381', 'path': '/dev/dm-4', 'multipath_id': '330000000ed995381'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:24:26.918599 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.036s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:26.918898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05ec875f-f541-41cd-99fa-fd7c1125c3ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:26.919028 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:26.948089 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:26.948518 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:26.948518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '141')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:26.949431 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad', '142')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:26.950206 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482816c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:26.950441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Removing multipathed devices sde, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:26.950679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flush multipath device 330000000b5ae7ca4 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:26.981524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:27.017177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:27.054676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:27.054767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:27.054940 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Attaching volume 3f6a81d2-127b-4ee2-a12c-6855ef9b623a to /dev/vdb
May 13 04:24:27.057610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:27.057720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:27.058756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:27.068463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:27.068671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:27.079079 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:27.079551 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:24:27.083610 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:27.086434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.097762 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:27.110015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:24:27.119406 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.40.100,3260]
May 13 04:24:27.119406 np0000000669 nova-compute[97951]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.40.100,3260] successful.
May 13 04:24:27.119406 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.134765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:27.147143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.159840 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.176799 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:24:27.177025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:24:27.185867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:24:27.187102 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fee3:389d', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac'] 
May 13 04:24:27.187266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:24:27.187357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:24:27.187584 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:27.187812 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updating existing volume attachment record: 7f154409-260a-463a-80ea-f1fc3c7224ca {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:24:27.197639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.50.100,3260]
May 13 04:24:27.197639 np0000000669 nova-compute[97951]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-05ec875f-f541-41cd-99fa-fd7c1125c3ad, portal: 192.168.50.100,3260] successful.
May 13 04:24:27.197639 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.223293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.223737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:27.223891 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== disconnect_volume: return (1341ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:27.224071 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:27.367855 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.428661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2134606091',display_name='tempest-TestVolumeBootPattern-server-2134606091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-2134606091',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-acec38f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:18Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=05623762-9272-41d8-97a9-1011e80eaa0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:24:27.432004 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:27.432004 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:27.432004 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 05623762-9272-41d8-97a9-1011e80eaa0e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:27.591805 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:27.765467 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '800b47ef-fd8d-41ee-a361-192302828766', 'attached_at': '', 'detached_at': '', 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'serial': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:24:27.768468 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:24:27.768780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:27.768901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:27.769395 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:27.769638 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:24:27.776058 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:27.784862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:27.785541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:27.786018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:27.786176 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:27.787293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:27.787530 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:27.799449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:27.799449 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.803468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:27.803468 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.812361 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a] added
May 13 04:24:27.812361 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:27.812361 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:27.812361 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:27.812361 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:27.812361 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:27.812361 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.812623 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:27.812705 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:27.812876 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:27.814097 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a] added
May 13 04:24:27.814097 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:27.814097 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:27.814097 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:27.814097 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:27.814097 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:27.814097 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:27.814372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:27.814499 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:27.814635 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:27.832975 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:27.833120 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:27.940154 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <uuid>05623762-9272-41d8-97a9-1011e80eaa0e</uuid>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <name>instance-0000003a</name>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-2134606091</nova:name>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:24:23</nova:creationTime>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         <nova:port uuid="2aacb877-832e-4772-a6f0-2621ad37a6f3">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <system>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="serial">05623762-9272-41d8-97a9-1011e80eaa0e</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="uuid">05623762-9272-41d8-97a9-1011e80eaa0e</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </system>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <os>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </os>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <features>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </features>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   <devices>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/disk.config"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <alias name="ua-940b1c4f-714f-4a08-bb68-b1f34ab06c08"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-4"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <serial>940b1c4f-714f-4a08-bb68-b1f34ab06c08</serial>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:71:ce:02"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <target dev="tap2aacb877-83"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </interface>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/console.log" append="off"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </serial>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <video>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </video>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </rng>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:   </devices>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]: </domain>
May 13 04:24:27.940154 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Preparing to wait for external event network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2134606091',display_name='tempest-TestVolumeBootPattern-server-2134606091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-2134606091',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-acec38f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:18Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=05623762-9272-41d8-97a9-1011e80eaa0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:24:27.943903 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:27.945663 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:27.945937 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:24:27.946346 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.946626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:27.946959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:24:27.948254 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.948458 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99794828-e812-5ec0-8248-115e5e982d3b', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:27.950249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.951630 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:27.955246 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.955459 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aacb877-83, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:27.955883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2aacb877-83, col_values=(('qos', UUID('e4a1e9ce-8920-480d-88d9-753a29f5696c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:27.956115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2aacb877-83, col_values=(('external_ids', {'iface-id': '2aacb877-832e-4772-a6f0-2621ad37a6f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ce:02', 'vm-uuid': '05623762-9272-41d8-97a9-1011e80eaa0e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:27.959844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:27.964662 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:27.965571 np0000000669 nova-compute[97951]: INFO os_vif [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83')
May 13 04:24:28.336192 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:28.782278 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3a23814d-aed3-480c-be87-ed3fc782b106 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:28.813317 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:28.815347 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:28.827314 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:28.827314 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:28.831884 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:28.831884 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.842642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.516s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:28.843068 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:24:28.846551 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.255s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:28.846794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:28.848526 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:24:28.849286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.851169 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.873807 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.893803 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.894948 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:28.924419 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.50.100,3260]
May 13 04:24:28.924419 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.50.100,3260] successful.
May 13 04:24:28.924419 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.941745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.942507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.40.100,3260]
May 13 04:24:28.942507 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.40.100,3260] successful.
May 13 04:24:28.942507 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.958900 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.968350 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:28.968350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:28.970200 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:28.970200 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.979785 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:28.980588 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:28.980588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:28.981228 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] HCTL ('10', '-', '-', 0) found on session 147 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:28.981393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:28.991298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:28.991298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:28.997475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:29.354313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:24:29.354646 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:24:29.355157 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:29.355639 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:29.483808 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:29.484056 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:29.484056 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:71:ce:02, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:29.484447 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Using config drive
May 13 04:24:29.510970 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf5682626aa450f922f2e02bfc18ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b631412fa14c72bc60d0fae2cec50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:24:29.857477 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:24:29.909978 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:29.992034 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:30.000856 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Successfully created port: 97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:24:30.005564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:30.006566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:30.020376 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.021050 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.039311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:30.147551 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.148032 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:24:30.153940 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:24:30.158713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.232732 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Creating config drive at /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/disk.config
May 13 04:24:30.236852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp__pspwfq {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.276383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.277183 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.317823 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp__pspwfq" returned: 0 in 0.080s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.359877 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:24:30.388083 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.395140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.505575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.506280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.636461 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.646383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.756152 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Successfully updated port: 97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:24:30.772897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.773479 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.815854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found WWN 330000000341017e9 for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:24:30.816794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:30.818709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000341017e9', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000341017e9'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:30.818709 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000341017e9', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000341017e9'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:24:30.827047 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-changed-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:30.827282 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Refreshing instance network info cache due to event network-changed-97435e82-7468-4e29-b9dc-74e80079dacf. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:30.828152 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] Acquiring lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:30.828450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] Acquired lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:30.829406 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Refreshing network info cache for port 97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:30.832796 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:24:30.833612 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:24:30.833612 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:24:30.834023 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7a463c10e7e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '800b47ef-fd8d-41ee-a361-192302828766', 'attached_at': '', 'detached_at': '', 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'serial': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:24:30.834268 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97951) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 04:24:30.836418 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] opening encrypted volume /dev/dm-3 {{(pid=97951) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 04:24:30.854376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:30.870276 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Booting with volume b3d25e4d-f61e-4134-9448-02154c8d239b at /dev/vda
May 13 04:24:30.893077 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:30.906824 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.luks [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 04:24:30.906824 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:30.907055 np0000000669 nova-compute[97951]: INFO os_brick.encryptors.luks [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] /dev/dm-3 is not a valid LUKS device; formatting device for first use
May 13 04:24:30.907055 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] formatting encrypted volume /dev/dm-3 {{(pid=97951) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 04:24:30.916285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:30.992298 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:30.992298 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:31.012022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:24:31.046210 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.067748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.069058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.118104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:24:31.120094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:24:31.136230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:24:31.138239 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd', 'fe80::fc16:3eff:fe08:ed36', 'fe80::fc16:3eff:fee3:389d', 'fe80::209d:c7ff:fe47:bc28', 'fe80::fc16:3eff:fe5c:5ff1', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe71:ce02', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:24:31.138495 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:24:31.139913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:24:31.139913 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:31.139913 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Updating existing volume attachment record: 18a20769-1a79-4c4f-beb3-9a54d562715f {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:24:31.190749 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3348adb5-0f31-4c36-92e0-090b60071a40 req-f614df70-9b91-49e4-a36d-2db917cf5c90 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:31.191001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3348adb5-0f31-4c36-92e0-090b60071a40 req-f614df70-9b91-49e4-a36d-2db917cf5c90 service nova] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:31.191184 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3348adb5-0f31-4c36-92e0-090b60071a40 req-f614df70-9b91-49e4-a36d-2db917cf5c90 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:31.191488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3348adb5-0f31-4c36-92e0-090b60071a40 req-f614df70-9b91-49e4-a36d-2db917cf5c90 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:31.191488 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3348adb5-0f31-4c36-92e0-090b60071a40 req-f614df70-9b91-49e4-a36d-2db917cf5c90 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Processing event network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:24:31.230083 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.237070 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:24:31.239171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.264590 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:31.333898 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:31.338174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:31.378164 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:31.380302 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:31.385521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.385882 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.427721 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:31.498829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.505638 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.613411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.615914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.647709 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:31.659960 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:31.767788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.777946 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:24:31.779143 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:31.832525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:31.836249 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=11207MB free_disk=72.71876525878906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:24:31.836249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:31.836249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:31.934846 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646271.934413, 05623762-9272-41d8-97a9-1011e80eaa0e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:31.935260 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] VM Started (Lifecycle Event)
May 13 04:24:31.936431 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:24:31.955899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:24:31.960934 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance spawned successfully.
May 13 04:24:31.961466 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:24:32.158443 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e08539a8-b9b5-4b7e-b063-7022cf7e71ea req-9bb23f40-e7dd-4efb-916e-ef4140808dac service nova] Releasing lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:32.159493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquired lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:32.159783 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:24:32.195344 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] instance snapshotting
May 13 04:24:32.328276 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Beginning live snapshot process
May 13 04:24:32.456039 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:32.471234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:32.480597 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.480762 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.481207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.481483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.481837 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.482178 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:32.540498 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:32.755600 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:32.938803 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.938903 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939706 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939706 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bef8f03b-9d16-489d-904e-04fbce74b056 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939706 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939706 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939706 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4b31b39a-956e-4428-9251-2f50db0eba9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939911 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 800b47ef-fd8d-41ee-a361-192302828766 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939911 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 05623762-9272-41d8-97a9-1011e80eaa0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.939989 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance aaf7483f-0b4e-47a7-ae63-92173a7a2afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:24:32.940293 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:24:32.940464 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:24:31 up 38 min,  2 users,  load average: 7.22, 7.86, 5.33\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '6', 'io_workload': '3', 'num_proj_15233deb57f94a479979c054d80e15cd': '1', 'num_task_image_snapshot': '1', 'num_proj_39efcc41639747809d8c2d84bdee24c5': '1', 'num_proj_e227d582564c4ef7b5ab8d19583df520': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_task_block_device_mapping': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:24:32.957908 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:32.979896 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:24:32.980341 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646272.9799988, 05623762-9272-41d8-97a9-1011e80eaa0e => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:32.980341 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] VM Paused (Lifecycle Event)
May 13 04:24:32.991408 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Took 9.15 seconds to spawn the instance on the hypervisor.
May 13 04:24:32.994319 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:32.998829 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:33.228465 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Updating instance_info_cache with network_info: [{"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:33.292599 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:33.293522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:33.293795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:33.294062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:33.294278 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] No waiting events found dispatching network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:33.294799 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c21cf457-15d6-499b-bcbe-c2b51be67f39 req-40f5e5cc-d1da-4bc9-91b6-b4ba3222f530 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received unexpected event network-vif-plugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 for instance with vm_state active and task_state None.
May 13 04:24:33.297860 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:24:33.299109 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:24:33.299400 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Creating image(s)
May 13 04:24:33.299682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:24:33.300140 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Ensure instance console log exists: /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:24:33.300409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:33.300542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:33.300815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:33.486341 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:33.497962 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646273.4975176, 05623762-9272-41d8-97a9-1011e80eaa0e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:33.498269 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] VM Resumed (Lifecycle Event)
May 13 04:24:33.520868 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Took 20.08 seconds to build instance.
May 13 04:24:33.686537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:33.686822 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:33.732382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Releasing lock "refresh_cache-aaf7483f-0b4e-47a7-ae63-92173a7a2afb" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:33.733593 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance network_info: |[{"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:24:33.738227 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Start _get_guest_xml network_info=[{"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'aaf7483f-0b4e-47a7-ae63-92173a7a2afb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'serial': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'multiattach': True}, 'disk_bus': 'virtio', 'attachment_id': '18a20769-1a79-4c4f-beb3-9a54d562715f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:24:33.741387 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:24:33.743428 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1163364685', uuid='aaf7483f-0b4e-47a7-ae63-92173a7a2afb'), owner=OwnerMeta(userid='7bf5682626aa450f922f2e02bfc18ddc', username='tempest-AttachVolumeMultiAttachTest-1762651840-project-member', projectid='a9b631412fa14c72bc60d0fae2cec50a', projectname='tempest-AttachVolumeMultiAttachTest-1762651840'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646273.7422743) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:24:33.744539 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:24:33.744916 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:24:33.750890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:24:33.751109 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:24:33.752417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:24:33.754644 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:24:33.754839 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:24:33.754944 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:24:33.755091 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:24:33.755719 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:24:33.755830 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:24:33.755996 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:24:33.756073 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:24:33.757757 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:24:33.757757 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:24:33.757757 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:24:33.772753 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:24:33.773480 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:33.773480 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:33.773797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:33.774027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:24:33.789305 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:33.789732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:33.790253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:33.790495 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:33.791387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:33.791898 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:33.804295 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:33.804295 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:33.810720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:33.810720 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:33.822871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b] added
May 13 04:24:33.822871 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:33.822871 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:33.822871 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:33.822871 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:33.822871 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:33.822871 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:33.823168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:33.823297 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:33.823483 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:33.836737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b] added
May 13 04:24:33.836737 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:33.836737 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:33.836737 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:33.836737 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:33.836737 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:33.836737 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:33.837040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:33.837040 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0453(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:33.837380 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:33.856188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:33.948413 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:33.953195 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json -f qcow2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:34.001822 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:34.018943 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:34.027348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.591s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:34.052852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:34.053744 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:34.058341 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:34.058341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:34.163192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:34.167959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776.delta 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:34.199195 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:34.240857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776.delta 1073741824" returned: 0 in 0.073s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:34.241901 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 04:24:34.529149 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:24:34.716557 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:24:34.716818 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.883s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:34.723989 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:34.723989 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 04:24:34.823980 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:34.837707 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:34.850548 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:34.850548 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:34.862178 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:34.862178 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.879697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.887003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.909979 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.910520 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:34.914259 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:34.971029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.50.100,3260]
May 13 04:24:34.971029 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.50.100,3260] successful.
May 13 04:24:34.971029 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.983790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:34.986883 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.40.100,3260]
May 13 04:24:34.986883 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.40.100,3260] successful.
May 13 04:24:34.986883 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:35.014373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.019347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:35.019347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:35.020189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('16', '-', '-', 0) found on session 148 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:35.020387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:35.033421 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:35.036868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=97951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 04:24:35.038788 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:35.043726 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:35.043726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:35.044817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 148 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:35.045016 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:35.046813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] HCTL ('17', '-', '-', 0) found on session 149 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:35.046959 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:35.070890 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Searching for a device in session 149 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:35.071274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:35.116092 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:24:35.116591 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776.delta /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:35.227170 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] There are 0 instances to clean {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 04:24:35.228858 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:35.392376 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:35.392867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:35.393078 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:35.393368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:35.393547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:35.399085 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Terminating instance
May 13 04:24:35.483411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776.delta /opt/stack/data/nova/instances/snapshots/tmpxi5vj3z2/ceb8395900a74005bef63e37c3f58776" returned: 0 in 0.367s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:35.489778 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Snapshot extracted, beginning image upload
May 13 04:24:35.742221 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:24:35.799043 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:24:35.905750 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:24:35.937622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:35.954160 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:35.959049 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:35.981782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:35.987315 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:36.090103 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:36.090359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:36.090535 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:36.090675 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:36.090838 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] No waiting events found dispatching network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:36.091009 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3812740-397e-46bb-bb53-f4df4bab85af req-1d5b4f48-25b5-4b4d-bf74-1209cc17d988 service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:36.252622 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999701879999975 future=<Future at 0x7a461c756e10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:36.252992 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99928424899963 future=<Future at 0x7a461c756e10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:36.253257 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998980979999942 future=<Future at 0x7a461c756e10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:36.254348 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Instance destroyed successfully.
May 13 04:24:36.254702 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 05623762-9272-41d8-97a9-1011e80eaa0e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:36.742218 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:36.742661 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:36.742798 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:36.743005 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:36.743234 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:24:36.743445 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:24:36.743629 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.34 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:24:36.762860 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2134606091',display_name='tempest-TestVolumeBootPattern-server-2134606091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-2134606091',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:24:33Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-acec38f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:24:33Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=05623762-9272-41d8-97a9-1011e80eaa0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:24:36.763307 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "address": "fa:16:3e:71:ce:02", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aacb877-83", "ovs_interfaceid": "2aacb877-832e-4772-a6f0-2621ad37a6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:36.764276 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:36.764772 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:24:36.766598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:36.766820 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aacb877-83, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:36.768823 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:36.770247 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:36.770872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:36.771036 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4a1e9ce-8920-480d-88d9-753a29f5696c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:36.772170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:36.772261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:36.774599 np0000000669 nova-compute[97951]: INFO os_vif [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ce:02,bridge_name='br-int',has_traffic_filtering=True,id=2aacb877-832e-4772-a6f0-2621ad37a6f3,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aacb877-83')
May 13 04:24:36.776065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:36.776408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:36.776578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:36.816767 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Found WWN 330000000326cf0c7 for multipath device dm-8 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:24:36.816767 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:36.816767 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000326cf0c7', 'path': '/dev/dm-8', 'multipath_id': '330000000326cf0c7'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:36.816767 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000326cf0c7', 'path': '/dev/dm-8', 'multipath_id': '330000000326cf0c7'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:24:36.817495 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:36.818008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '940b1c4f-714f-4a08-bb68-b1f34ab06c08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:36.818255 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:36.851479 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08 (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:36.851861 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:36.852250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5986d562-14b4-46ed-8e56-8fef56f0ad0b', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:36.852250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '144')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:36.853516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08', '145')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:36.854572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464857e3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:36.854782 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdj, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:36.855030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 330000000ed995381 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:36.901126 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:36.945475 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:36.999828 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdj, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:37.000080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdj, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:37.001445 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdj', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:37.013982 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdj', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:37.014245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:37.030253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.070939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.40.100,3260]
May 13 04:24:37.070939 np0000000669 nova-compute[97951]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.40.100,3260] successful.
May 13 04:24:37.070939 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.090695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.103414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.136773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.50.100,3260]
May 13 04:24:37.136773 np0000000669 nova-compute[97951]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-940b1c4f-714f-4a08-bb68-b1f34ab06c08, portal: 192.168.50.100,3260] successful.
May 13 04:24:37.136773 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.159894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:37.160161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:37.160336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (383ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:37.160503 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:37.160824 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Deleting instance files /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e_del
May 13 04:24:37.161700 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Deletion of /opt/stack/data/nova/instances/05623762-9272-41d8-97a9-1011e80eaa0e_del complete
May 13 04:24:37.329138 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1163364685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-1163364685',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-g99xe08d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:30Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=aaf7483f-0b4e-47a7-ae63-92173a7a2afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:24:37.329138 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:37.329138 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:37.329138 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'pci_devices' on Instance uuid aaf7483f-0b4e-47a7-ae63-92173a7a2afb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:37.669178 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Took 1.76 seconds to destroy the instance on the hypervisor.
May 13 04:24:37.669894 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:37.670227 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:37.670316 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:37.670588 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:37.685938 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] opening encrypted volume /dev/dm-3 {{(pid=97951) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 04:24:37.745192 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:37.833256 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] End _get_guest_xml xml=<domain type="qemu">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <uuid>aaf7483f-0b4e-47a7-ae63-92173a7a2afb</uuid>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <name>instance-0000003b</name>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1163364685</nova:name>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:24:33</nova:creationTime>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:user uuid="7bf5682626aa450f922f2e02bfc18ddc">tempest-AttachVolumeMultiAttachTest-1762651840-project-member</nova:user>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:project uuid="a9b631412fa14c72bc60d0fae2cec50a">tempest-AttachVolumeMultiAttachTest-1762651840</nova:project>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         <nova:port uuid="97435e82-7468-4e29-b9dc-74e80079dacf">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <system>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="serial">aaf7483f-0b4e-47a7-ae63-92173a7a2afb</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="uuid">aaf7483f-0b4e-47a7-ae63-92173a7a2afb</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </system>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <os>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </os>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <features>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </features>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   <devices>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/disk.config"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <alias name="ua-b3d25e4d-f61e-4134-9448-02154c8d239b"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-8"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <serial>b3d25e4d-f61e-4134-9448-02154c8d239b</serial>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <shareable/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:0e:a8:b6"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <target dev="tap97435e82-74"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </interface>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/console.log" append="off"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </serial>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <video>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </video>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </rng>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:   </devices>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]: </domain>
May 13 04:24:37.833256 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:24:37.836384 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Preparing to wait for external event network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:24:37.836384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:37.836384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:37.836384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:37.836384 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1163364685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-1163364685',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-g99xe08d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:30Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=aaf7483f-0b4e-47a7-ae63-92173a7a2afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:24:37.837757 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:37.837757 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:37.838034 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:24:37.838502 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.838761 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:37.839023 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:24:37.843511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.843920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aaef64f-97f0-5122-beac-0b79c05c897f', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:37.845991 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.846824 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:37.846962 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.850990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.851185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97435e82-74, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:37.851517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97435e82-74, col_values=(('qos', UUID('c3d206df-6b90-4f7a-9694-3d2ebbb6fc7b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:37.855350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97435e82-74, col_values=(('external_ids', {'iface-id': '97435e82-7468-4e29-b9dc-74e80079dacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a8:b6', 'vm-uuid': 'aaf7483f-0b4e-47a7-ae63-92173a7a2afb'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:37.859808 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:37.862812 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:37.864088 np0000000669 nova-compute[97951]: INFO os_vif [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74')
May 13 04:24:38.069472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7df4528d-37d4-4044-afb1-c1b03671598e req-9ef55a37-e013-4f2f-8a5e-f10509facc6a service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-deleted-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:38.070648 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-7df4528d-37d4-4044-afb1-c1b03671598e req-9ef55a37-e013-4f2f-8a5e-f10509facc6a service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Neutron deleted interface 2aacb877-832e-4772-a6f0-2621ad37a6f3; detaching it from the instance and deleting it from the info cache
May 13 04:24:38.071745 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7df4528d-37d4-4044-afb1-c1b03671598e req-9ef55a37-e013-4f2f-8a5e-f10509facc6a service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:38.157150 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:38.157748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] Acquiring lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:38.157901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:38.158023 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] Lock "05623762-9272-41d8-97a9-1011e80eaa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:38.158187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] No waiting events found dispatching network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:38.158306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bc654e08-d862-4ad2-8f5d-766409a3b2de req-15d43f41-78b8-4ae2-98b9-cd6a3fef67fe service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Received event network-vif-unplugged-2aacb877-832e-4772-a6f0-2621ad37a6f3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:38.196468 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Snapshot image upload complete
May 13 04:24:38.196710 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bccf2bae-7a0d-4714-8c72-53eb1d9e6a75 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Took 6.01 seconds to snapshot the instance on the hypervisor.
May 13 04:24:38.507307 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:38.575672 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7df4528d-37d4-4044-afb1-c1b03671598e req-9ef55a37-e013-4f2f-8a5e-f10509facc6a service nova] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Detach interface failed, port_id=2aacb877-832e-4772-a6f0-2621ad37a6f3, reason: Instance 05623762-9272-41d8-97a9-1011e80eaa0e could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:24:39.010342 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Took 1.34 seconds to deallocate network for instance.
May 13 04:24:39.389831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:39.389941 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:39.390006 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] No VIF found with MAC fa:16:3e:0e:a8:b6, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:39.390469 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Using config drive
May 13 04:24:39.562697 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:24:39.564609 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Deleting volume: 940b1c4f-714f-4a08-bb68-b1f34ab06c08 {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:24:39.620301 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:39.896212 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:40.026571 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Creating config drive at /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/disk.config
May 13 04:24:40.030736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgkh76drl {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:40.045842 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.089412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgkh76drl" returned: 0 in 0.059s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:40.113145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:40.113431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:40.123732 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Attempting to attach volume 3f6a81d2-127b-4ee2-a12c-6855ef9b623a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:24:40.125596 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:   <alias name="ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a"/>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:   <serial>3f6a81d2-127b-4ee2-a12c-6855ef9b623a</serial>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:40.125596 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:24:40.602496 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:40.602752 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:40.637155 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.657965 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:40.658314 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:40.668150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.767610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.796040 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.797495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:40.853042 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-09db7bd6-9c0e-4d4b-a1eb-b76a4d88b5ac req-645dcf22-ad7c-4308-abaf-67052fe11eda service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:40.853291 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09db7bd6-9c0e-4d4b-a1eb-b76a4d88b5ac req-645dcf22-ad7c-4308-abaf-67052fe11eda service nova] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:40.854340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09db7bd6-9c0e-4d4b-a1eb-b76a4d88b5ac req-645dcf22-ad7c-4308-abaf-67052fe11eda service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:40.855697 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-09db7bd6-9c0e-4d4b-a1eb-b76a4d88b5ac req-645dcf22-ad7c-4308-abaf-67052fe11eda service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:40.855697 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-09db7bd6-9c0e-4d4b-a1eb-b76a4d88b5ac req-645dcf22-ad7c-4308-abaf-67052fe11eda service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Processing event network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:24:41.104901 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:24:41.162085 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:41.451794 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646281.4513156, aaf7483f-0b4e-47a7-ae63-92173a7a2afb => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:41.452418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:24:41.452652 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] VM Started (Lifecycle Event)
May 13 04:24:41.454889 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:24:41.458071 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance spawned successfully.
May 13 04:24:41.458759 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:24:41.667353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:41.670356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.556s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:41.671265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:41.675242 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:24:41.675444 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Claim successful on node np0000000669
May 13 04:24:41.735349 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 05623762-9272-41d8-97a9-1011e80eaa0e
May 13 04:24:41.940572 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:41.940737 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:41.940790 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:41.940907 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] No VIF found with MAC fa:16:3e:e3:38:9d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:41.955601 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:41.958694 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:41.966182 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:41.966348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:41.966711 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:41.966769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:41.967037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:41.968356 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:42.460783 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:24:42.463157 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646282.4618316, aaf7483f-0b4e-47a7-ae63-92173a7a2afb => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:42.463157 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] VM Paused (Lifecycle Event)
May 13 04:24:42.471383 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Took 9.17 seconds to spawn the instance on the hypervisor.
May 13 04:24:42.471536 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:42.742218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-67d557bc-b5f5-4dfb-9af0-d70e218c4620 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "05623762-9272-41d8-97a9-1011e80eaa0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.349s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:42.853995 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] No waiting events found dispatching network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:42.922416 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-848646a8-9cdc-4b64-a62a-b197f44cd651 req-3e78c582-bade-41b0-8895-0587ca1a8c0a service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received unexpected event network-vif-plugged-97435e82-7468-4e29-b9dc-74e80079dacf for instance with vm_state active and task_state None.
May 13 04:24:42.964828 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:42.969290 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646282.9690847, aaf7483f-0b4e-47a7-ae63-92173a7a2afb => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:42.969624 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] VM Resumed (Lifecycle Event)
May 13 04:24:42.983342 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Took 16.71 seconds to build instance.
May 13 04:24:43.355706 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:43.355936 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:43.472106 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:43.474419 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:43.483819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.219s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:43.509238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-28bb5770-5efb-4304-8a34-7adccd0b030b tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.454s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:43.859172 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:44.287598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:44.368601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.697s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:44.369241 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:24:44.408851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:44.409072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:44.428337 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:44.429604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing instance network info cache due to event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:44.429858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:44.429955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:44.430099 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:44.874826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:24:44.875585 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:24:44.875918 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:44.876906 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:44.914399 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Detaching volume 3f6a81d2-127b-4ee2-a12c-6855ef9b623a
May 13 04:24:44.934353 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:44.962885 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Attempting to driver detach volume 3f6a81d2-127b-4ee2-a12c-6855ef9b623a from mountpoint /dev/vdb
May 13 04:24:44.964711 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df44e041ec8940e0be0bc8bcd9cc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39efcc41639747809d8c2d84bdee24c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:24:45.013373 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:45.014178 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing instance network info cache due to event network-changed-a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:45.014361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] Acquiring lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:45.015107 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '800b47ef-fd8d-41ee-a361-192302828766', 'attached_at': '', 'detached_at': '', 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'serial': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:24:45.021884 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:45.022960 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Found disk vdb by alias ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:45.023026 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Attempting to detach device vdb from instance 800b47ef-fd8d-41ee-a361-192302828766 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:24:45.023252 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <alias name="ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a"/>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <serial>3f6a81d2-127b-4ee2-a12c-6855ef9b623a</serial>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:45.023252 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:45.030881 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance 800b47ef-fd8d-41ee-a361-192302828766 from the persistent domain config.
May 13 04:24:45.031066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] (1/8): Attempting to detach device vdb with device alias ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a from instance 800b47ef-fd8d-41ee-a361-192302828766 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:24:45.031286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <alias name="ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a"/>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <serial>3f6a81d2-127b-4ee2-a12c-6855ef9b623a</serial>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:45.031286 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:45.036727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:45.036949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:45.053081 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:45.293835 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:45.376935 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:24:45.540806 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Detaching volume 100627b2-b9ef-4b63-b542-edea8b56bf7c
May 13 04:24:45.566219 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updated VIF entry in instance network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:24:45.566219 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:45.586574 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Successfully created port: ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:24:45.589447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646285.5891929, 800b47ef-fd8d-41ee-a361-192302828766 => ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:24:45.590652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3f6a81d2-127b-4ee2-a12c-6855ef9b623a for instance 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:24:45.594486 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully detached device vdb from instance 800b47ef-fd8d-41ee-a361-192302828766 from the live domain config.
May 13 04:24:45.594486 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:24:45.594682 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:24:45.594802 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:24:45.596838 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7a464840bc20>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '800b47ef-fd8d-41ee-a361-192302828766', 'attached_at': '', 'detached_at': '', 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'serial': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:24:45.596838 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] closing encrypted volume /dev/dm-4 {{(pid=97951) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 13 04:24:45.604454 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Attempting to driver detach volume 100627b2-b9ef-4b63-b542-edea8b56bf7c from mountpoint /dev/vdb
May 13 04:24:45.614467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found disk vdb by alias ua-100627b2-b9ef-4b63-b542-edea8b56bf7c {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:45.615994 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found disk vdb by alias ua-100627b2-b9ef-4b63-b542-edea8b56bf7c {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:24:45.616089 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Attempting to detach device vdb from instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:24:45.616344 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <alias name="ua-100627b2-b9ef-4b63-b542-edea8b56bf7c"/>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <serial>100627b2-b9ef-4b63-b542-edea8b56bf7c</serial>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:45.616344 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:45.623949 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully detached device vdb from instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 from the persistent domain config.
May 13 04:24:45.624188 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] (1/8): Attempting to detach device vdb with device alias ua-100627b2-b9ef-4b63-b542-edea8b56bf7c from instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:24:45.624484 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <alias name="ua-100627b2-b9ef-4b63-b542-edea8b56bf7c"/>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-7"/>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <serial>100627b2-b9ef-4b63-b542-edea8b56bf7c</serial>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]: </disk>
May 13 04:24:45.624484 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:24:45.633298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:45.633651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:45.633875 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:45.634280 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:45.634584 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:45.634717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:45.672682 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:45.672926 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:45.673122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:45.673188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '147')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:45.675506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a', '146')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:45.676314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c74aac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:45.676563 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Removing multipathed devices sdd, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:45.676845 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Flush multipath device 330000000341017e9 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:45.713260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:45.763906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:45.818308 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:45.818308 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:45.823264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:45.841657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:45.841657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:45.861237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:45.879801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:24:45.905145 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.40.100,3260]
May 13 04:24:45.905145 np0000000669 nova-compute[97951]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.40.100,3260] successful.
May 13 04:24:45.905145 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:45.926237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:45.942918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:45.985136 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.50.100,3260]
May 13 04:24:45.985136 np0000000669 nova-compute[97951]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-3f6a81d2-127b-4ee2-a12c-6855ef9b623a, portal: 192.168.50.100,3260] successful.
May 13 04:24:45.985136 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.005732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.008458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:46.008458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] <== disconnect_volume: return (374ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:46.008815 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:46.069486 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e1b44175-3f01-4ceb-b5dd-f767170575d9 req-5fc6673d-5a7e-43a3-b2da-4588864048cb service nova] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:46.070088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] Acquired lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:46.070291 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Refreshing network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:46.260394 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Successfully updated port: ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:24:46.364547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646286.3641975, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => ua-100627b2-b9ef-4b63-b542-edea8b56bf7c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:24:46.366450 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-100627b2-b9ef-4b63-b542-edea8b56bf7c for instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:24:46.380443 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully detached device vdb from instance 36799b72-3299-47fa-b174-6ad9bf4d63c9 from the live domain config.
May 13 04:24:46.383216 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:46.383589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:46.383734 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:46.384093 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:46.384439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100627b2-b9ef-4b63-b542-edea8b56bf7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:46.388346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:46.419465 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:46.420008 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:46.420008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '140')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:46.420844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c', '139')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:46.421655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c6ff380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'): ({'sdh'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:46.421844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:46.422201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flush multipath device 3300000002082c1eb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:46.457190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:46.511667 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:46.556262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:46.556511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:46.558823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:46.576757 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'flavor' on Instance uuid 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:46.578112 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:46.581880 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:46.586913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:46.599691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.637670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260]
May 13 04:24:46.637670 np0000000669 nova-compute[97951]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.40.100,3260] successful.
May 13 04:24:46.637670 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.638977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:46.639179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:46.639431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:46.639642 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:46.639772 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:46.645113 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Terminating instance
May 13 04:24:46.669605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.685700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.715158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260]
May 13 04:24:46.715158 np0000000669 nova-compute[97951]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-100627b2-b9ef-4b63-b542-edea8b56bf7c, portal: 192.168.50.100,3260] successful.
May 13 04:24:46.715158 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.734239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:46.734549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:46.734682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== disconnect_volume: return (351ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:46.734842 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:46.765717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:46.765892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquired lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:46.766044 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:24:46.892869 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:24:46.893862 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:24:46.894373 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Creating image(s)
May 13 04:24:46.894923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:46.895165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:46.895710 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:46.895979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "eaf12c946df01ff59b010c0c7f72542d941c9904" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:46.896213 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "eaf12c946df01ff59b010c0c7f72542d941c9904" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:46.992300 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:47.095189 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:47.095498 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing instance network info cache due to event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:47.095921 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] Acquiring lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:47.154210 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:24:47.167576 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updated VIF entry in instance network info cache for port a1871dfc-c535-41da-820b-0aff99f672b1. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:24:47.167872 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [{"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:47.175418 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:47.213348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:47.303668 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:47.353683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:47.361097 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:47.380353 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:47.541845 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999651616999927 future=<Future at 0x7a463c715c10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:47.549306 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Instance destroyed successfully.
May 13 04:24:47.551366 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid aaf7483f-0b4e-47a7-ae63-92173a7a2afb {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:47.599715 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aa81fee3-5863-4e27-a0e3-151c7206b202 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.191s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:47.671159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87656f04-2738-4917-8d80-a0a93400b74f req-60c39283-2fa5-42e8-9df5-76ec177131ca service nova] Releasing lock "refresh_cache-36799b72-3299-47fa-b174-6ad9bf4d63c9" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:47.721909 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:47.845772 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:47.846026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:47.846242 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:47.846425 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:47.846587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:47.849390 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Terminating instance
May 13 04:24:47.857262 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:47.913145 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating instance_info_cache with network_info: [{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:47.946293 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:47.948454 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:47.948722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.057351 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1163364685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-1163364685',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:24:42Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-g99xe08d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:24:43Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=aaf7483f-0b4e-47a7-ae63-92173a7a2afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:24:48.057351 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "97435e82-7468-4e29-b9dc-74e80079dacf", "address": "fa:16:3e:0e:a8:b6", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97435e82-74", "ovs_interfaceid": "97435e82-7468-4e29-b9dc-74e80079dacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:48.057351 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:48.057351 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:24:48.057988 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.058386 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97435e82-74, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:48.061393 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.part --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.061553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.063207 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] 55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01 was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:24:48.063434 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:48.064424 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:24:48.064544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.064720 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3d206df-6b90-4f7a-9694-3d2ebbb6fc7b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:48.065262 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.part /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.065481 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.066028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:48.081422 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.086754 np0000000669 nova-compute[97951]: INFO os_vif [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a8:b6,bridge_name='br-int',has_traffic_filtering=True,id=97435e82-7468-4e29-b9dc-74e80079dacf,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97435e82-74')
May 13 04:24:48.135358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:24:48.135957 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:48.136076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:48.136632 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:48.137034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3d25e4d-f61e-4134-9448-02154c8d239b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:24:48.137269 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:24:48.164009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:48.164009 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:48.164009 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:48.164009 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:48.164009 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:48.164009 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b (non-flash)
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064 (non-flash)
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:48.164365 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:48.164365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3f1877f-ba10-4b7c-941c-e8942d21c064', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:24:48.164646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '149')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:48.165310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b', '148')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:24:48.166353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c74a5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'): ({'sdk'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:24:48.166353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Removing multipathed devices sdk, sdl {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:24:48.167290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flush multipath device 330000000326cf0c7 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:24:48.226096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:48.257245 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.part /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.converted" returned: 0 in 0.192s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.274806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:24:48.275581 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.323175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b490df04-1732-41a5-ae28-336b4c02ad5d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.286s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:48.333337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:24:48.336339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:24:48.336339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:24:48.348164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:24:48.348505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:24:48.354191 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:24:48.365769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.368792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904.converted --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.369698 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "eaf12c946df01ff59b010c0c7f72542d941c9904" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.473s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:48.370156 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:48.374505 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:48.375530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.392623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.404599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.407311 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.40.100,3260]
May 13 04:24:48.407311 np0000000669 nova-compute[97951]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.40.100,3260] successful.
May 13 04:24:48.407311 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.419008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Releasing lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:48.419867 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Instance network_info: |[{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:24:48.420582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] Acquired lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:48.422944 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:48.425439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.430401 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.440268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.481367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.50.100,3260]
May 13 04:24:48.481367 np0000000669 nova-compute[97951]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b3d25e4d-f61e-4134-9448-02154c8d239b, portal: 192.168.50.100,3260] successful.
May 13 04:24:48.481367 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.492873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.494147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "eaf12c946df01ff59b010c0c7f72542d941c9904" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:48.494668 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "eaf12c946df01ff59b010c0c7f72542d941c9904" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:48.495118 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:48.500002 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:24:48.500372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.502894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:48.502894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:48.502894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== disconnect_volume: return (367ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:48.503210 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:24:48.503475 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Deleting instance files /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb_del
May 13 04:24:48.517721 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Deletion of /opt/stack/data/nova/instances/aaf7483f-0b4e-47a7-ae63-92173a7a2afb_del complete
May 13 04:24:48.555248 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:48.555574 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:48.555832 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:48.556001 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:48.556311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] No waiting events found dispatching network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:48.556311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-764f48ba-0fdc-400c-9614-5a6c986d6570 req-85667581-6aff-46c3-bc57-7e5eb437b3a7 service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:48.612135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.612952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904,backing_fmt=raw /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.661439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.667926 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:48.670441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904,backing_fmt=raw /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk 1073741824" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.670887 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "eaf12c946df01ff59b010c0c7f72542d941c9904" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:48.671255 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:48.702544 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997287198999857 future=<Future at 0x7a463c714c20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:48.705987 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Instance destroyed successfully.
May 13 04:24:48.706801 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lazy-loading 'resources' on Instance uuid 800b47ef-fd8d-41ee-a361-192302828766 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf12c946df01ff59b010c0c7f72542d941c9904 --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Ensure instance console log exists: /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:48.771073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:48.774380 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Start _get_guest_xml network_info=[{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='3a369459b22c21f8cb87020ce84d45ef',container_format='bare',created_at=2026-05-13T04:24:30Z,direct_url=<?>,disk_format='qcow2',id=55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-730517751',owner='39efcc41639747809d8c2d84bdee24c5',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-13T04:24:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:24:48.781644 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:24:48.784472 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-177546076', uuid='6264bd46-a20d-42b4-a876-169ea74fde0a'), owner=OwnerMeta(userid='df44e041ec8940e0be0bc8bcd9cc1f4b', username='tempest-TestStampPattern-2044631915-project-member', projectid='39efcc41639747809d8c2d84bdee24c5', projectname='tempest-TestStampPattern-2044631915'), image=ImageMeta(id='55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '39efcc41639747809d8c2d84bdee24c5'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646288.7831824) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:24:48.787920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:24:48.791439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:24:48.794789 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:24:48.795022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:24:48.796261 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:24:48.796680 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3a369459b22c21f8cb87020ce84d45ef',container_format='bare',created_at=2026-05-13T04:24:30Z,direct_url=<?>,disk_format='qcow2',id=55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-730517751',owner='39efcc41639747809d8c2d84bdee24c5',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-13T04:24:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:24:48.796888 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:24:48.797023 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:24:48.797161 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:24:48.797280 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:24:48.798160 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:24:48.798392 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:24:48.798537 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:24:48.798665 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:24:48.798811 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:24:48.798960 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:24:48.828531 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-177546076',display_name='tempest-TestStampPattern-server-177546076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-177546076',id=60,image_ref='55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-0out8mo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b31b39a-956e-4428-9251-2f50db0eba9b',image_min_disk='1',image_min_ram='0',image_owner_id='39efcc41639747809d8c2d84bdee24c5',image_owner_project_name='tempest-TestStampPattern-2044631915',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2044631915-project-member',image_user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',network_allocated='True',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:46Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=6264bd46-a20d-42b4-a876-169ea74fde0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:24:48.828734 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:48.830261 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:48.831108 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'pci_devices' on Instance uuid 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:48.926897 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.029194 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Took 1.87 seconds to destroy the instance on the hypervisor.
May 13 04:24:49.030284 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:49.031197 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:49.031296 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:49.031527 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.090881 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.173008 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:49.173817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:49.174246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:49.175018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:49.175018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] No waiting events found dispatching network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:49.175018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:49.175018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:49.175206 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Acquiring lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:49.175303 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:49.175495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:49.175666 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] No waiting events found dispatching network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:49.176121 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d8d3fd0-d997-429d-85a6-96089a52e84d req-bab624da-c9a2-41c1-a06a-211405d5a18d service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-unplugged-97435e82-7468-4e29-b9dc-74e80079dacf for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:49.212365 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790166615',display_name='tempest-TestEncryptedCinderVolumes-server-1790166615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1790166615',id=57,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaM9UcfNrAL9XDPXkR77MSKPqU8riVhGKRxpcYwge5D9640bdM78mj/RpdzFFL7+2DZ3eikc57RIAHNF25TPCCws4pWdTESp0SLwxLrj9Ojqkudi3TrqFZUoVB/UkHEg==',key_name='tempest-keypair-1025909438',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:45Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e227d582564c4ef7b5ab8d19583df520',ramdisk_id='',reservation_id='r-rkkrgtq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-280722860',owner_user_name='tempest-TestEncryptedCinderVolumes-280722860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='434adac2000c4da29488decad2034361',uuid=800b47ef-fd8d-41ee-a361-192302828766,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:24:49.212581 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converting VIF {"id": "670b85cb-d621-4858-b259-4f790fff88c8", "address": "fa:16:3e:e3:38:9d", "network": {"id": "27306617-98e8-42a6-a18f-1e9fce9ffa1a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-2085621351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e227d582564c4ef7b5ab8d19583df520", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap670b85cb-d6", "ovs_interfaceid": "670b85cb-d621-4858-b259-4f790fff88c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:49.212945 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:49.213166 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:24:49.217388 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.217701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap670b85cb-d6, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.220275 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.221228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:49.221819 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.221926 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9404c00-5703-4233-9026-ef62bbcf8a03) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.222388 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.222882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:49.223451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.225208 np0000000669 nova-compute[97951]: INFO os_vif [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=670b85cb-d621-4858-b259-4f790fff88c8,network=Network(27306617-98e8-42a6-a18f-1e9fce9ffa1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670b85cb-d6')
May 13 04:24:49.225562 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Deleting instance files /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766_del
May 13 04:24:49.226534 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Deletion of /opt/stack/data/nova/instances/800b47ef-fd8d-41ee-a361-192302828766_del complete
May 13 04:24:49.282780 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.343291 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] End _get_guest_xml xml=<domain type="qemu">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <uuid>6264bd46-a20d-42b4-a876-169ea74fde0a</uuid>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <name>instance-0000003c</name>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestStampPattern-server-177546076</nova:name>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:24:48</nova:creationTime>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:property name="img_owner_id">39efcc41639747809d8c2d84bdee24c5</nova:property>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:user uuid="df44e041ec8940e0be0bc8bcd9cc1f4b">tempest-TestStampPattern-2044631915-project-member</nova:user>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:project uuid="39efcc41639747809d8c2d84bdee24c5">tempest-TestStampPattern-2044631915</nova:project>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         <nova:port uuid="ce17d644-1137-47bc-aa59-2bc9c2f78124">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <system>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="serial">6264bd46-a20d-42b4-a876-169ea74fde0a</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="uuid">6264bd46-a20d-42b4-a876-169ea74fde0a</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </system>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <os>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </os>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <features>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </features>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   <devices>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.config"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </disk>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:91:45:0d"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <target dev="tapce17d644-11"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </interface>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/console.log" append="off"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </serial>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <video>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </video>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </rng>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:   </devices>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]: </domain>
May 13 04:24:49.343291 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Preparing to wait for external event network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-177546076',display_name='tempest-TestStampPattern-server-177546076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-177546076',id=60,image_ref='55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-0out8mo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b31b39a-956e-4428-9251-2f50db0eba9b',image_min_disk='1',image_min_ram='0',image_owner_id='39efcc41639747809d8c2d84bdee24c5',image_owner_project_name='tempest-TestStampPattern-2044631915',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2044631915-project-member',image_user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',network_allocated='True',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:46Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=6264bd46-a20d-42b4-a876-169ea74fde0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:24:49.345933 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:49.346281 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:49.347118 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:24:49.347118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.347118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.347545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:24:49.349185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.349344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6b35687-be1d-59a2-a342-86c515ad1cec', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.350072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.350825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:49.352639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.355284 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.355461 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce17d644-11, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.355760 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce17d644-11, col_values=(('qos', UUID('c442818e-8840-4ebe-8b4d-6b14cbb1be77')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.355942 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce17d644-11, col_values=(('external_ids', {'iface-id': 'ce17d644-1137-47bc-aa59-2bc9c2f78124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:45:0d', 'vm-uuid': '6264bd46-a20d-42b4-a876-169ea74fde0a'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:49.356958 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.358782 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:49.365226 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:49.366531 np0000000669 nova-compute[97951]: INFO os_vif [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11')
May 13 04:24:49.421582 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b89578ab-7147-4661-a06e-5afc68b26351 req-996184b9-2736-4e44-8a7a-b43d7b6328d4 service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Received event network-vif-deleted-97435e82-7468-4e29-b9dc-74e80079dacf {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:49.421728 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-b89578ab-7147-4661-a06e-5afc68b26351 req-996184b9-2736-4e44-8a7a-b43d7b6328d4 service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Neutron deleted interface 97435e82-7468-4e29-b9dc-74e80079dacf; detaching it from the instance and deleting it from the info cache
May 13 04:24:49.422012 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b89578ab-7147-4661-a06e-5afc68b26351 req-996184b9-2736-4e44-8a7a-b43d7b6328d4 service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:49.465806 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updated VIF entry in instance network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:24:49.466501 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating instance_info_cache with network_info: [{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:49.732875 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 04:24:49.733921 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:49.734261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:49.734391 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:49.734641 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.805359 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:49.818158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:49.818158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:49.878252 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:49.927347 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b89578ab-7147-4661-a06e-5afc68b26351 req-996184b9-2736-4e44-8a7a-b43d7b6328d4 service nova] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Detach interface failed, port_id=97435e82-7468-4e29-b9dc-74e80079dacf, reason: Instance aaf7483f-0b4e-47a7-ae63-92173a7a2afb could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:24:49.968855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e2902c21-b4e0-4800-85ac-7f5bcadb26de req-e8eedc3f-55da-4f9d-b875-8a8c5182754a service nova] Releasing lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:50.319901 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:24:50.382356 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Took 1.35 seconds to deallocate network for instance.
May 13 04:24:50.626613 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:50.627227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] Acquiring lock "800b47ef-fd8d-41ee-a361-192302828766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:50.627433 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:50.627561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] Lock "800b47ef-fd8d-41ee-a361-192302828766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:50.627703 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] No waiting events found dispatching network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:50.627862 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bfea492-9b86-4dc6-bc3e-d05ca680aef2 req-28de0aaa-de21-49b5-9855-5e7b47efba4c service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-unplugged-670b85cb-d621-4858-b259-4f790fff88c8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:50.688604 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:50.688604 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:50.688604 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:50.688914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:50.688914 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:50.691428 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Terminating instance
May 13 04:24:50.879346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:50.879462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:50.883916 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:24:50.884079 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Claim successful on node np0000000669
May 13 04:24:50.890561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:50.890685 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:24:50.891036 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No VIF found with MAC fa:16:3e:91:45:0d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:24:50.891267 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Using config drive
May 13 04:24:50.933767 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:24:51.187585 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:51.194125 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:24:51.216707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.219120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.234693 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.240639 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.252626 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00036132900004304247 future=<Future at 0x7a461c756e10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:51.253570 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646276.2521656, 05623762-9272-41d8-97a9-1011e80eaa0e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:51.253570 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:51.253570 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] VM Stopped (Lifecycle Event)
May 13 04:24:51.254705 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=11.28687102799995 future=<Future at 0x7a463c715c10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:51.254705 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=11.286750856999788 future=<Future at 0x7a463c715c10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:51.260576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.270203 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:51.397635 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:51.439582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:51.497129 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Received event network-vif-deleted-670b85cb-d621-4858-b259-4f790fff88c8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:51.498261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9a31662-f488-4d8d-916b-d8ada0929da7 req-840bb8f2-46f2-423b-b884-ac1de236107f service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:51.533020 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999688957999751 future=<Future at 0x7a464816aae0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:24:51.534073 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Instance destroyed successfully.
May 13 04:24:51.534737 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'resources' on Instance uuid 36799b72-3299-47fa-b174-6ad9bf4d63c9 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:24:51.543635 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Creating config drive at /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.config
May 13 04:24:51.547264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprfjh1oyj {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:51.608061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprfjh1oyj" returned: 0 in 0.060s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:24:51.690203 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Took 1.96 seconds to deallocate network for instance.
May 13 04:24:51.757502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 05623762-9272-41d8-97a9-1011e80eaa0e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:51.973049 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Refreshing inventories for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 04:24:52.014142 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Updating ProviderTree inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 04:24:52.014419 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:24:52.037612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1195377242',display_name='tempest-TestMinimumBasicScenario-server-1195377242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-1195377242',id=55,image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh8jD+ZYi4xk1Op5Q/uwOu0fqdr95UYw4r/9c25PqYqUwjYiLubxx0PC73huNQ4KI8KKT5Sg0Q+p5iIID4ZfL8R82M424R77jRojheFkiV5XC0r/9oz2VqeA4Wzm05PJQ==',key_name='tempest-TestMinimumBasicScenario-1086957482',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:13Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-qeoqewx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='91bc70b4-027b-4c11-8520-0391d2b0b0a9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:24:06Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=36799b72-3299-47fa-b174-6ad9bf4d63c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:24:52.037612 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "a1871dfc-c535-41da-820b-0aff99f672b1", "address": "fa:16:3e:5c:5f:f1", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1871dfc-c5", "ovs_interfaceid": "a1871dfc-c535-41da-820b-0aff99f672b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:24:52.037612 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:24:52.037902 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:24:52.038526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.041039 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.041748 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1871dfc-c5, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:52.043344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.044102 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:52.059970 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Refreshing aggregate associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, aggregates: None {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 04:24:52.069363 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.072017 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.073600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.073600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd76c4be-1f8c-4a6a-b2ef-b678ae7c3ad6) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:24:52.073758 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.074236 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:24:52.075478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.078097 np0000000669 nova-compute[97951]: INFO os_vif [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:5f:f1,bridge_name='br-int',has_traffic_filtering=True,id=a1871dfc-c535-41da-820b-0aff99f672b1,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1871dfc-c5')
May 13 04:24:52.078392 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Deleting instance files /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9_del
May 13 04:24:52.079086 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Deletion of /opt/stack/data/nova/instances/36799b72-3299-47fa-b174-6ad9bf4d63c9_del complete
May 13 04:24:52.117464 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Refreshing trait associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_ICH9,HW_ARCH_X86_64,HW_CPU_X86_SSE,COMPUTE_ARCH_X86_64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ARCH_PPC64LE,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 04:24:52.163041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.163813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.177230 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:52.197713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:52.235632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8e07d14e-79c1-47a9-bf94-6b440c8bbe5d req-26f30b7e-57c4-4150-9f11-4c514863255f service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:52.235780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8e07d14e-79c1-47a9-bf94-6b440c8bbe5d req-26f30b7e-57c4-4150-9f11-4c514863255f service nova] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:52.236003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8e07d14e-79c1-47a9-bf94-6b440c8bbe5d req-26f30b7e-57c4-4150-9f11-4c514863255f service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:52.236169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8e07d14e-79c1-47a9-bf94-6b440c8bbe5d req-26f30b7e-57c4-4150-9f11-4c514863255f service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:52.236305 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8e07d14e-79c1-47a9-bf94-6b440c8bbe5d req-26f30b7e-57c4-4150-9f11-4c514863255f service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Processing event network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:24:52.586942 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:24:52.588595 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:24:52.588985 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:24:52.589132 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:24:52.589439 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:52.674908 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:52.675145 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:52.695397 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:52.887602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:24:52.888162 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646292.88772, 6264bd46-a20d-42b4-a876-169ea74fde0a => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:52.888350 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] VM Started (Lifecycle Event)
May 13 04:24:52.890192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:24:52.892233 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Instance spawned successfully.
May 13 04:24:52.892583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:24:52.896853 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:52.897160 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:24:53.177769 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:53.393896 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:53.396598 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:53.402621 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Took 6.51 seconds to spawn the instance on the hypervisor.
May 13 04:24:53.402872 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:53.455231 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:53.574170 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:53.574573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] Acquiring lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:53.574731 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:53.574869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:53.575000 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] No waiting events found dispatching network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:53.575394 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-71293be5-f9aa-4849-83a3-06b5939a5bd7 req-8eed70fd-1f7c-466a-b0fb-64afe9d9396d service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-unplugged-a1871dfc-c535-41da-820b-0aff99f672b1 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:24:53.684892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.805s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:53.685736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.246s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:53.686410 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:24:53.898377 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:24:53.898659 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646293.8984714, 6264bd46-a20d-42b4-a876-169ea74fde0a => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:53.899392 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] VM Paused (Lifecycle Event)
May 13 04:24:53.911932 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Took 12.30 seconds to build instance.
May 13 04:24:53.957180 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Took 1.37 seconds to deallocate network for instance.
May 13 04:24:54.200191 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:24:54.201353 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:24:54.201463 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:54.201611 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:54.288136 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:24:54.318571 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:54.318571 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:54.318742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:54.318907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:54.319092 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] No waiting events found dispatching network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:24:54.319152 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received unexpected event network-vif-plugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 for instance with vm_state active and task_state None.
May 13 04:24:54.319409 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87be53e5-56d6-4d22-ac30-c4a80a9aef3b req-e748f499-add0-4121-a956-a890f3bc6e66 service nova] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Received event network-vif-deleted-a1871dfc-c535-41da-820b-0aff99f672b1 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:54.359273 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:54.359566 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:54.405172 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:54.407030 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646294.4068556, 6264bd46-a20d-42b4-a876-169ea74fde0a => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:24:54.407132 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] VM Resumed (Lifecycle Event)
May 13 04:24:54.413955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2affecf3-133c-4f3c-886d-da157abdb4ab tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.811s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:54.466863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:54.704302 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:24:54.842372 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Successfully created port: 893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:24:54.861823 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:54.909279 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:24:54.912100 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:24:55.063560 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:55.207974 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:24:55.355078 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Successfully updated port: 893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:24:55.369682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.684s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:55.371410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.172s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:55.430998 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance aaf7483f-0b4e-47a7-ae63-92173a7a2afb
May 13 04:24:55.658490 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received event network-changed-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:55.658801 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Refreshing instance network info cache due to event network-changed-893a21bf-366b-44d1-a678-d03d23bc1db6. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:55.658917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] Acquiring lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:55.659031 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] Acquired lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:55.659184 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Refreshing network info cache for port 893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:55.711863 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Booting with volume f7967647-9080-4299-abb1-c3a1e438481c at /dev/vda
May 13 04:24:55.754208 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:55.765189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:24:55.788589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:24:55.851031 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:24:55.851279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:24:55.857756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:55.863952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:24:55.865161 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe91:450d', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fee3:255', 'fe80::fc16:3eff:fe9e:609d', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd', 'fe80::fc16:3eff:fe08:ed36'] 
May 13 04:24:55.865312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:24:55.865463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:24:55.865726 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:24:55.865954 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating existing volume attachment record: 7819a3fb-49f3-41ac-849c-79cf0e67d6a5 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:24:55.970427 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:55.970637 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:56.161113 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:56.223719 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:56.361221 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:56.382848 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:24:56.383148 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing instance network info cache due to event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:24:56.383337 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] Acquiring lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:24:56.383514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] Acquired lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:56.383569 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:24:56.441057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff6f80ee-984f-4786-8c08-875db242253e tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "aaf7483f-0b4e-47a7-ae63-92173a7a2afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.802s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:56.473244 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:56.863184 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d9c8aecb-04ef-41f8-91d7-981dd49e6da5 req-14db531c-876b-4163-b300-fe715c0092b1 service nova] Releasing lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:56.863640 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:24:56.863862 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:24:56.885431 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:56.979828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.610s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:56.982796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.516s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:57.074397 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Deleted allocations for instance 800b47ef-fd8d-41ee-a361-192302828766
May 13 04:24:57.076583 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:24:57.256922 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:57.475007 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:24:57.486844 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updated VIF entry in instance network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:24:57.486844 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating instance_info_cache with network_info: [{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:57.634353 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:24:57.634353 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:24:57.681409 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:24:57.803802 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating instance_info_cache with network_info: [{"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:24:57.981134 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:24:57.982383 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:24:57.982641 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Creating image(s)
May 13 04:24:57.982932 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:24:57.983069 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Ensure instance console log exists: /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:24:57.983405 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:57.984407 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:57.984646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:57.993186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c3959ebe-e0e5-4a10-b1ec-21754a6c8081 req-5c44b307-1cbf-48d2-a44e-d477e0ff334b service nova] Releasing lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:58.082672 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fd79f338-e2e1-41a0-baca-d79dde1f1152 tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Lock "800b47ef-fd8d-41ee-a361-192302828766" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.237s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:58.136560 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:24:58.306214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:24:58.306639 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance network_info: |[{"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:24:58.307385 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Start _get_guest_xml network_info=[{"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f4022180-db9e-4d9d-903c-9f0c7e8c2cf2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'serial': 'f7967647-9080-4299-abb1-c3a1e438481c'}, 'disk_bus': 'virtio', 'attachment_id': '7819a3fb-49f3-41ac-849c-79cf0e67d6a5', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:24:58.310304 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:24:58.311762 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-817065001', uuid='f4022180-db9e-4d9d-903c-9f0c7e8c2cf2'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646298.3113663) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:24:58.313087 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:24:58.313486 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:24:58.314572 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:24:58.314779 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:24:58.315863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:24:58.316223 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:24:58.316437 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:24:58.316574 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:24:58.316772 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:24:58.316902 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:24:58.317039 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:24:58.317217 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:24:58.317382 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:24:58.317523 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:24:58.317649 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:24:58.317845 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:24:58.334509 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:24:58.335012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:24:58.335195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:58.335607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:58.335920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:24:58.350590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:58.351009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:24:58.351473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:58.351672 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:58.352146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:24:58.352276 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:58.365565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:58.365565 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:58.372628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:24:58.372628 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:58.377397 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c] added
May 13 04:24:58.377397 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:58.377397 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:58.377397 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:58.377397 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:58.377397 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:58.377397 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:58.377647 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:58.377742 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:58.377873 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:58.389635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c] added
May 13 04:24:58.389635 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:24:58.389635 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:58.389635 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:58.389635 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:24:58.389635 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:24:58.389635 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:58.389909 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:24:58.390071 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:24:58.390269 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:24:58.646738 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.664s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:58.698042 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Deleted allocations for instance 36799b72-3299-47fa-b174-6ad9bf4d63c9
May 13 04:24:59.378416 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:24:59.390872 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:59.392350 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:59.392350 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:24:59.407002 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:24:59.407002 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.416677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.421889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.429447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.429447 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.429447 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:59.429606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.429606 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.429606 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:59.436347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.436347 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.436347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:59.436567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.436567 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.436567 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:59.461283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.50.100,3260]
May 13 04:24:59.461283 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.50.100,3260] successful.
May 13 04:24:59.461283 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.468086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.40.100,3260]
May 13 04:24:59.468086 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.40.100,3260] successful.
May 13 04:24:59.468086 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.480864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.484920 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:24:59.501960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.501960 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.501960 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.501960 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.501960 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:59.502103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.502103 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.502103 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.502103 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.502103 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:59.502360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:59.503391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:59.503391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('9', '-', '-', 0) found on session 151 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:59.503391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:59.504761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.504761 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.504761 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.504761 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.504761 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:24:59.504882 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.504882 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:24:59.504882 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.504882 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:24:59.504882 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:24:59.505098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:24:59.505296 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:24:59.505929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('10', '-', '-', 0) found on session 152 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:24:59.506026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:24:59.520228 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 151 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:59.520372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:59.539834 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 152 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:24:59.539834 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:24:59.706738 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-147a6f12-bdfa-450b-8200-aad5d9fccf66 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "36799b72-3299-47fa-b174-6ad9bf4d63c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.018s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:59.767757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:59.767947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:59.768156 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:24:59.768348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:24:59.768497 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:24:59.770393 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Terminating instance
May 13 04:25:00.064503 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.274096 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:00.297815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.299988 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.323185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.352141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:25:00.437678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.444349 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:00.456550 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:00.456808 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:00.456982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:00.457137 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:00.457348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:00.457445 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d650e218-a1ac-4830-81f4-79e483b513f7 req-9ec8fd08-6f80-49de-8092-26b45ae1211b service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:00.621737 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99961275600026 future=<Future at 0x7a461c7bc9b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:00.623725 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Instance destroyed successfully.
May 13 04:25:00.624450 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:01.129284 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=50,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:41Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-144a1709',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=3df1fc73-4ebd-40cf-b61f-2e4d911aa81f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:01.129517 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "address": "fa:16:3e:08:ed:36", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0faab3e7-86", "ovs_interfaceid": "0faab3e7-86ec-4f70-8d30-d950d7dd4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:01.130262 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:01.130611 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:01.134553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.134831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0faab3e7-86, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:01.138526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.139301 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:01.208731 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.209999 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.210341 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3555a3d-6b7f-43f6-8e24-ce9f2f95a81b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:01.212286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.212764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:01.216310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:01.216624 np0000000669 nova-compute[97951]: INFO os_vif [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ed:36,bridge_name='br-int',has_traffic_filtering=True,id=0faab3e7-86ec-4f70-8d30-d950d7dd4592,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0faab3e7-86')
May 13 04:25:01.216882 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Deleting instance files /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_del
May 13 04:25:01.226528 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Deletion of /opt/stack/data/nova/instances/3df1fc73-4ebd-40cf-b61f-2e4d911aa81f_del complete
May 13 04:25:01.371725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 33000000060927597 for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:25:01.372059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:01.372261 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000060927597', 'path': '/dev/dm-3', 'multipath_id': '33000000060927597'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:01.372467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000060927597', 'path': '/dev/dm-3', 'multipath_id': '33000000060927597'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:25:01.735080 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Took 1.46 seconds to destroy the instance on the hypervisor.
May 13 04:25:01.735769 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:01.736088 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:01.736193 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:01.736402 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:01.814034 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:01.882836 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817065001',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817065001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-volume-backed-server-817065001',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY6j8RZnDrBEsCp71PxgkErTDAXe4mFwsDt+WSI1ymmMkv/h6eB8oZZNhRddt/ilpvaNPP6NGcdR5ZZEbwWYJJ10BB+aKHNjT7ps/LzijOeFDiRcPuGaD4YvYEtBnb0Gg==',key_name='tempest-keypair-2068273764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-0yhjt9ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=f4022180-db9e-4d9d-903c-9f0c7e8c2cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:25:01.884682 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:01.885359 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:01.886194 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:02.343471 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f85c486a-c4e0-44bb-95c5-8592fe3b463a req-6157155c-12b1-4883-83dd-c1a77aac3c2f service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-deleted-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:02.344060 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-f85c486a-c4e0-44bb-95c5-8592fe3b463a req-6157155c-12b1-4883-83dd-c1a77aac3c2f service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Neutron deleted interface 0faab3e7-86ec-4f70-8d30-d950d7dd4592; detaching it from the instance and deleting it from the info cache
May 13 04:25:02.344205 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-f85c486a-c4e0-44bb-95c5-8592fe3b463a req-6157155c-12b1-4883-83dd-c1a77aac3c2f service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:02.395403 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] End _get_guest_xml xml=<domain type="qemu">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <uuid>f4022180-db9e-4d9d-903c-9f0c7e8c2cf2</uuid>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <name>instance-0000003d</name>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-817065001</nova:name>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:24:58</nova:creationTime>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         <nova:port uuid="893a21bf-366b-44d1-a678-d03d23bc1db6">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <system>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="serial">f4022180-db9e-4d9d-903c-9f0c7e8c2cf2</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="uuid">f4022180-db9e-4d9d-903c-9f0c7e8c2cf2</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </system>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <os>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </os>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <features>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </features>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   <devices>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/disk.config"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </disk>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <alias name="ua-f7967647-9080-4299-abb1-c3a1e438481c"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <serial>f7967647-9080-4299-abb1-c3a1e438481c</serial>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </disk>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:4b:1c:ad"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <target dev="tap893a21bf-36"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </interface>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/console.log" append="off"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </serial>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <video>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </video>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </rng>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:   </devices>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]: </domain>
May 13 04:25:02.395403 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Preparing to wait for external event network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817065001',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817065001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-volume-backed-server-817065001',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY6j8RZnDrBEsCp71PxgkErTDAXe4mFwsDt+WSI1ymmMkv/h6eB8oZZNhRddt/ilpvaNPP6NGcdR5ZZEbwWYJJ10BB+aKHNjT7ps/LzijOeFDiRcPuGaD4YvYEtBnb0Gg==',key_name='tempest-keypair-2068273764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-0yhjt9ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=f4022180-db9e-4d9d-903c-9f0c7e8c2cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '313b856c-229a-514a-ac22-555313321872', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:02.399790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.400977 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:02.402728 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.404385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.404533 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap893a21bf-36, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:02.404813 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap893a21bf-36, col_values=(('qos', UUID('badda1cc-dbce-4984-90e2-363b5b56fea6')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:02.404956 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap893a21bf-36, col_values=(('external_ids', {'iface-id': '893a21bf-366b-44d1-a678-d03d23bc1db6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:1c:ad', 'vm-uuid': 'f4022180-db9e-4d9d-903c-9f0c7e8c2cf2'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:02.405691 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.406737 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:02.412303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:02.413432 np0000000669 nova-compute[97951]: INFO os_vif [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36')
May 13 04:25:02.535026 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:02.535239 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] Acquiring lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:02.535338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:02.535602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:02.535602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] No waiting events found dispatching network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:02.536461 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7b17a1a4-d01f-4830-99a5-5b62c8378321 req-43e4eb84-e1cc-4746-ad9c-eec456e738ed service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Received event network-vif-unplugged-0faab3e7-86ec-4f70-8d30-d950d7dd4592 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:02.542341 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003995460001533502 future=<Future at 0x7a463c715c10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:02.542341 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:02.542341 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.157677061999948 future=<Future at 0x7a463c714c20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:02.542341 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=1.1575702439999986 future=<Future at 0x7a463c714c20 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:02.542817 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Emitting event <LifecycleEvent: 1778646287.5413706, aaf7483f-0b4e-47a7-ae63-92173a7a2afb => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:02.543201 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] VM Stopped (Lifecycle Event)
May 13 04:25:02.766552 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:02.848965 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f85c486a-c4e0-44bb-95c5-8592fe3b463a req-6157155c-12b1-4883-83dd-c1a77aac3c2f service nova] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Detach interface failed, port_id=0faab3e7-86ec-4f70-8d30-d950d7dd4592, reason: Instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:25:03.048388 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: aaf7483f-0b4e-47a7-ae63-92173a7a2afb] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:03.143750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:03.143923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:03.182399 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:03.268579 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Took 1.53 seconds to deallocate network for instance.
May 13 04:25:03.646256 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:25:03.700177 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00041255200039813644 future=<Future at 0x7a463c714c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:03.700265 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:03.700415 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.8320979339996484 future=<Future at 0x7a464816aae0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:03.700529 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=2.8319864479999524 future=<Future at 0x7a464816aae0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:03.701363 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Emitting event <LifecycleEvent: 1778646288.6996186, 800b47ef-fd8d-41ee-a361-192302828766 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:03.701532 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] VM Stopped (Lifecycle Event)
May 13 04:25:03.775822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:03.777902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:03.935860 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:03.935967 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:03.936061 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:4b:1c:ad, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:25:03.936437 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Using config drive
May 13 04:25:04.204356 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 800b47ef-fd8d-41ee-a361-192302828766] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:04.206165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:04.229822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:04.230753 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:04.441949 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:04.566219 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Creating config drive at /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/disk.config
May 13 04:25:04.571709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_etcnpzt {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:04.629339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_etcnpzt" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:04.733677 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:05.080605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.113223 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.195263 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.243431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.465s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:05.245889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.038s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:05.254788 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:25:05.254937 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Claim successful on node np0000000669
May 13 04:25:05.322189 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f
May 13 04:25:05.328418 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6894ed8d-e10f-4950-8fdf-fc517905c15f req-4212ba27-c815-419d-b36f-577dc1125c26 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received event network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:05.328418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6894ed8d-e10f-4950-8fdf-fc517905c15f req-4212ba27-c815-419d-b36f-577dc1125c26 service nova] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:05.328575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6894ed8d-e10f-4950-8fdf-fc517905c15f req-4212ba27-c815-419d-b36f-577dc1125c26 service nova] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:05.328666 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6894ed8d-e10f-4950-8fdf-fc517905c15f req-4212ba27-c815-419d-b36f-577dc1125c26 service nova] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:05.328826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6894ed8d-e10f-4950-8fdf-fc517905c15f req-4212ba27-c815-419d-b36f-577dc1125c26 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Processing event network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:25:05.499721 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.502920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.505557 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.506746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.538337 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:05.927921 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646305.9274383, f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:05.928530 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:25:05.929217 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] VM Started (Lifecycle Event)
May 13 04:25:05.933066 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:25:05.936962 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance spawned successfully.
May 13 04:25:05.938944 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:25:06.339562 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-263c7c66-80f2-43c4-b4da-fbe6a22a5576 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "3df1fc73-4ebd-40cf-b61f-2e4d911aa81f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.571s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:06.435094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:06.439190 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:06.447458 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.447678 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.448077 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.448390 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.448698 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.448966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:06.535707 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.003146822999951837 future=<Future at 0x7a464816aae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:06.536445 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778646291.5324564, 36799b72-3299-47fa-b174-6ad9bf4d63c9 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:06.536858 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:06.536982 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.08429728100009 future=<Future at 0x7a461c7bc9b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:06.537113 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.084201183000005 future=<Future at 0x7a461c7bc9b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:06.538672 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] VM Stopped (Lifecycle Event)
May 13 04:25:06.743966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:06.745434 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:06.944632 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:25:06.944888 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646306.9447148, f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:06.944996 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] VM Paused (Lifecycle Event)
May 13 04:25:06.956889 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Took 8.98 seconds to spawn the instance on the hypervisor.
May 13 04:25:06.957489 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:07.043376 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 36799b72-3299-47fa-b174-6ad9bf4d63c9] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:07.106214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:07.106214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:07.106878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:07.106878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:07.106878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:07.111827 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Terminating instance
May 13 04:25:07.246932 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:07.397744 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received event network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:07.399545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:07.399545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:07.399545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:07.399545 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] No waiting events found dispatching network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:07.399545 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-730d5949-6b3c-4f9f-9283-984325eedd0f req-96009838-ffdf-4e4b-9074-84df05453978 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received unexpected event network-vif-plugged-893a21bf-366b-44d1-a678-d03d23bc1db6 for instance with vm_state active and task_state None.
May 13 04:25:07.408063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.447117 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:07.449422 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646307.4491522, f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:07.449570 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] VM Resumed (Lifecycle Event)
May 13 04:25:07.467249 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Took 16.64 seconds to build instance.
May 13 04:25:07.616831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:07.635028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.637147 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.666059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.754062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:07.756512 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:25:07.792798 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.801617 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:07.951790 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:07.954987 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:07.960665 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Instance destroyed successfully.
May 13 04:25:07.963306 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid bef8f03b-9d16-489d-904e-04fbce74b056 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:07.968582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e9535c9-6c9c-4dff-9a54-e0474078ca77 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.150s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:08.022261 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:08.022492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:08.022792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:08.024475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:08.024475 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:08.024475 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9c9302ac-0253-4dea-a54e-4409f6aa5e67 req-8f2c2b6b-485a-4162-a669-c839cbec24c2 service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:08.263582 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:25:08.263789 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:25:08.264104 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:08.264393 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:08.370911 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4e261ef262474d9c74dd8bf2b35d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15233deb57f94a479979c054d80e15cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:25:08.458867 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999710718000188 future=<Future at 0x7a461c785a60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:08.466783 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=48,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:22:37Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-bzyz6qc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bef8f03b-9d16-489d-904e-04fbce74b056,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:08.467115 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "address": "fa:16:3e:9e:60:9d", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d23fe88-4c", "ovs_interfaceid": "3d23fe88-4cef-4e24-9b41-83156fdda4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:08.467797 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:08.468062 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:08.469387 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.469580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d23fe88-4c, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:08.486122 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.486993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:08.487447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.488135 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.488471 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75924a53-b8fb-4dfe-aaa0-4e93a2fee86c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:08.488964 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.489493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:08.490073 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:08.494412 np0000000669 nova-compute[97951]: INFO os_vif [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:60:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d23fe88-4cef-4e24-9b41-83156fdda4d0,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d23fe88-4c')
May 13 04:25:08.494788 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Deleting instance files /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_del
May 13 04:25:08.505342 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Deletion of /opt/stack/data/nova/instances/bef8f03b-9d16-489d-904e-04fbce74b056_del complete
May 13 04:25:08.766223 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:25:08.887650 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Successfully created port: c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:25:09.017906 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:25:09.019162 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:09.019546 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:09.019659 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:09.019889 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:09.105680 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:09.271625 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:25:09.477425 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1e879b6-7eb4-4f8a-9bc5-7f222e7d0a4e req-f66ea7f5-40ac-412a-a614-252a93da7feb service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-deleted-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:09.478457 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-e1e879b6-7eb4-4f8a-9bc5-7f222e7d0a4e req-f66ea7f5-40ac-412a-a614-252a93da7feb service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Neutron deleted interface 3d23fe88-4cef-4e24-9b41-83156fdda4d0; detaching it from the instance and deleting it from the info cache
May 13 04:25:09.478682 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e1e879b6-7eb4-4f8a-9bc5-7f222e7d0a4e req-f66ea7f5-40ac-412a-a614-252a93da7feb service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:09.487136 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Successfully updated port: c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:25:09.541009 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:09.541361 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing instance network info cache due to event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:09.541597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:09.541597 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:09.542251 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:09.847553 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:09.982116 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e1e879b6-7eb4-4f8a-9bc5-7f222e7d0a4e req-f66ea7f5-40ac-412a-a614-252a93da7feb service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Detach interface failed, port_id=3d23fe88-4cef-4e24-9b41-83156fdda4d0, reason: Instance bef8f03b-9d16-489d-904e-04fbce74b056 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:25:09.993890 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:10.046652 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:10.082714 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:10.089188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:10.089482 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Acquiring lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:10.089745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:10.090057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Lock "bef8f03b-9d16-489d-904e-04fbce74b056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:10.090240 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] No waiting events found dispatching network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:10.090306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Received event network-vif-unplugged-3d23fe88-4cef-4e24-9b41-83156fdda4d0 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:10.090539 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received event network-changed-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:10.090710 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Refreshing instance network info cache due to event network-changed-893a21bf-366b-44d1-a678-d03d23bc1db6. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:10.091008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Acquiring lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:10.091159 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Acquired lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:10.091333 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Refreshing network info cache for port 893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:10.122019 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:25:10.276172 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:10.284360 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:25:10.285863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:25:10.285863 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Creating image(s)
May 13 04:25:10.285863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:10.285863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:10.286244 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:10.286625 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "491a78a8fd3b195836f634508525af9313b69db4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:10.286892 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "491a78a8fd3b195836f634508525af9313b69db4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:10.352362 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Took 1.33 seconds to deallocate network for instance.
May 13 04:25:10.594704 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:10.779604 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c08d9b91-1535-4cc9-8861-40a4308673c6 req-dab221bf-9e6a-4514-8d8a-3631138d7695 service nova] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:10.780157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:10.781249 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:25:10.861342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:10.861576 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:10.870923 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:10.876308 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:10.876885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.part --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:10.993243 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.part --force-share --output=json" returned: 0 in 0.116s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:10.993687 np0000000669 nova-compute[97951]: DEBUG nova.virt.images [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] 07df39e3-0478-4398-b4a8-449f89d75a5d was qcow2, converting to raw {{(pid=97951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 04:25:10.994617 np0000000669 nova-compute[97951]: DEBUG nova.privsep.utils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 04:25:10.994930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.part /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.converted {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.135194 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:11.156470 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.part /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.converted" returned: 0 in 0.161s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.161257 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.converted --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.249997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.250627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "491a78a8fd3b195836f634508525af9313b69db4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.964s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:11.251040 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:11.255624 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:11.256963 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.350507 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updated VIF entry in instance network info cache for port 893a21bf-366b-44d1-a678-d03d23bc1db6. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:25:11.350931 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating instance_info_cache with network_info: [{"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:11.361658 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:25:11.372409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.376905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "491a78a8fd3b195836f634508525af9313b69db4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:11.377792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "491a78a8fd3b195836f634508525af9313b69db4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:11.383294 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:11.387258 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:25:11.387768 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.500620 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.501108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4,backing_fmt=raw /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.554102 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:11.554291 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:11.559394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4,backing_fmt=raw /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk 1073741824" returned: 0 in 0.058s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.559851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "491a78a8fd3b195836f634508525af9313b69db4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:11.560265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.680110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491a78a8fd3b195836f634508525af9313b69db4 --force-share --output=json" returned: 0 in 0.119s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.680704 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:25:11.680971 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:11.699962 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:11.769679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:11.770013 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Cannot resize image /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:25:11.770368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:25:11.770544 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:25:11.770794 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:11.770993 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:11.771110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:11.830293 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:11.853534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e6f61ffc-95d6-4e95-914b-dbd619fc2116 req-436217a9-c735-47f0-bca3-31e20897418a service nova] Releasing lock "refresh_cache-f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:12.060427 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:12.333016 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:12.333286 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance network_info: |[{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:25:12.335750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Start _get_guest_xml network_info=[{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:25:00Z,direct_url=<?>,disk_format='qcow2',id=07df39e3-0478-4398-b4a8-449f89d75a5d,min_disk=0,min_ram=0,name='tempest-scenario-img--302737905',owner='15233deb57f94a479979c054d80e15cd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:25:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '07df39e3-0478-4398-b4a8-449f89d75a5d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:25:12.340706 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:25:12.342104 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='07df39e3-0478-4398-b4a8-449f89d75a5d', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-148825096', uuid='e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3'), owner=OwnerMeta(userid='9d4e261ef262474d9c74dd8bf2b35d1a', username='tempest-TestMinimumBasicScenario-1268923831-project-member', projectid='15233deb57f94a479979c054d80e15cd', projectname='tempest-TestMinimumBasicScenario-1268923831'), image=ImageMeta(id='07df39e3-0478-4398-b4a8-449f89d75a5d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646312.3417358) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:25:12.343276 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:25:12.343696 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:25:12.344759 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:25:12.344949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:25:12.345972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:25:12.346370 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:25:00Z,direct_url=<?>,disk_format='qcow2',id=07df39e3-0478-4398-b4a8-449f89d75a5d,min_disk=0,min_ram=0,name='tempest-scenario-img--302737905',owner='15233deb57f94a479979c054d80e15cd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:25:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:25:12.346573 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:25:12.347010 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:25:12.347172 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:25:12.347291 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:25:12.347438 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:25:12.347646 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:25:12.347784 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:25:12.347924 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:25:12.348055 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:25:12.348202 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:25:12.362951 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148825096',display_name='tempest-TestMinimumBasicScenario-server-148825096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-148825096',id=62,image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYWeyUPxyUrkhqVD6ymjfxi4jKnvFy/TuIQKMBbfyusfwbkOr+dvkWM8wt9Jabkuarlx4QIMxaN8RkdTVQQye3bB0JWrVtvPTuUE6F+9x9OMWxAee5M1XKoVCkDqG1uZQ==',key_name='tempest-TestMinimumBasicScenario-611504227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-esnzqb20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:25:09Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:25:12.363235 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:12.363774 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:12.364477 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'pci_devices' on Instance uuid e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:12.572707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.711s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:12.635655 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance bef8f03b-9d16-489d-904e-04fbce74b056
May 13 04:25:12.867396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] End _get_guest_xml xml=<domain type="qemu">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <uuid>e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3</uuid>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <name>instance-0000003e</name>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestMinimumBasicScenario-server-148825096</nova:name>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:25:12</nova:creationTime>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:image uuid="07df39e3-0478-4398-b4a8-449f89d75a5d">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:user uuid="9d4e261ef262474d9c74dd8bf2b35d1a">tempest-TestMinimumBasicScenario-1268923831-project-member</nova:user>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:project uuid="15233deb57f94a479979c054d80e15cd">tempest-TestMinimumBasicScenario-1268923831</nova:project>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="07df39e3-0478-4398-b4a8-449f89d75a5d"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         <nova:port uuid="c62e4f9b-9483-4521-b01f-972b5b41cb2d">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <system>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="serial">e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="uuid">e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </system>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <os>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </os>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <features>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </features>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   <devices>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </disk>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.config"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </disk>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:da:8d:a5"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <target dev="tapc62e4f9b-94"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </interface>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/console.log" append="off"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </serial>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <video>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </video>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </rng>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:   </devices>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]: </domain>
May 13 04:25:12.867396 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Preparing to wait for external event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148825096',display_name='tempest-TestMinimumBasicScenario-server-148825096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-148825096',id=62,image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYWeyUPxyUrkhqVD6ymjfxi4jKnvFy/TuIQKMBbfyusfwbkOr+dvkWM8wt9Jabkuarlx4QIMxaN8RkdTVQQye3bB0JWrVtvPTuUE6F+9x9OMWxAee5M1XKoVCkDqG1uZQ==',key_name='tempest-TestMinimumBasicScenario-611504227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-esnzqb20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:25:09Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:12.870068 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:25:12.870867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.871169 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:12.871592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:25:12.872637 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.872785 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2dfc96bd-ebf5-5e3e-b396-baa20ff6b350', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:12.873711 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.874330 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:12.874794 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.877336 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.877575 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc62e4f9b-94, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:12.877923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc62e4f9b-94, col_values=(('qos', UUID('ab554b0b-654a-4af9-a0a7-e579ad97642c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:12.878126 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc62e4f9b-94, col_values=(('external_ids', {'iface-id': 'c62e4f9b-9483-4521-b01f-972b5b41cb2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:8d:a5', 'vm-uuid': 'e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:12.879029 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.880174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:12.884722 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:12.885729 np0000000669 nova-compute[97951]: INFO os_vif [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94')
May 13 04:25:13.649241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cabfea61-9488-40d6-8bca-89dd67223878 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bef8f03b-9d16-489d-904e-04fbce74b056" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.542s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:14.405831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:14.406194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:14.406194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No VIF found with MAC fa:16:3e:da:8d:a5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:25:14.406900 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Using config drive
May 13 04:25:14.912410 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:15.035805 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Creating config drive at /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.config
May 13 04:25:15.039049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkl1_ck0a {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:15.089584 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.098229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkl1_ck0a" returned: 0 in 0.059s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:15.486046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:15.486046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:15.486046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:15.486046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:15.486046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:15.489602 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Terminating instance
May 13 04:25:15.577109 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.609737 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.622253 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004807739996977034 future=<Future at 0x7a461c7bc9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:15.622253 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:15.622253 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.8365511840002 future=<Future at 0x7a461c785a60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:15.622253 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.836476467000011 future=<Future at 0x7a461c785a60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:15.622563 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Emitting event <LifecycleEvent: 1778646300.6212108, 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:15.622742 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] VM Stopped (Lifecycle Event)
May 13 04:25:15.708217 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.756448 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9b6bcf3-b467-415e-b2cc-cbea3109de9e req-a3fd4464-3c3e-48ed-905b-2972801c8be5 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:15.756676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9b6bcf3-b467-415e-b2cc-cbea3109de9e req-a3fd4464-3c3e-48ed-905b-2972801c8be5 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:15.756848 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9b6bcf3-b467-415e-b2cc-cbea3109de9e req-a3fd4464-3c3e-48ed-905b-2972801c8be5 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:15.757018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9b6bcf3-b467-415e-b2cc-cbea3109de9e req-a3fd4464-3c3e-48ed-905b-2972801c8be5 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:15.757162 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9b6bcf3-b467-415e-b2cc-cbea3109de9e req-a3fd4464-3c3e-48ed-905b-2972801c8be5 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Processing event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:25:15.947191 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.949850 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.953345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.975649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:15.992493 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:16.013314 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.024459 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.037774 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.125555 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: 3df1fc73-4ebd-40cf-b61f-2e4d911aa81f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:16.184591 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:16.184795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:16.184984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:16.185119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:16.185255 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] No waiting events found dispatching network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:16.185404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-075a4030-2504-4777-8fc5-bf7f2d2c34e6 req-50b31f64-8648-468b-9300-a9470a3c6ed8 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:16.199870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.205074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.332746 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999676392999845 future=<Future at 0x7a463c1345c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:16.335875 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Instance destroyed successfully.
May 13 04:25:16.336257 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:16.591914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:25:16.592486 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646316.5922477, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:16.592657 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Started (Lifecycle Event)
May 13 04:25:16.598868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:25:16.600907 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance spawned successfully.
May 13 04:25:16.601170 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:25:16.838564 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-1',id=42,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:38Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-z0q5wxx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=bb3874f1-4ceb-4a94-9d9e-e388fb6a3400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:16.838767 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "55e9c21b-9829-40e1-98cc-037540f69e41", "address": "fa:16:3e:e3:02:55", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e9c21b-98", "ovs_interfaceid": "55e9c21b-9829-40e1-98cc-037540f69e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:16.839376 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:16.839586 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:16.841311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.841642 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55e9c21b-98, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:16.842769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.843769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:16.844046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.844957 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.845124 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e5dd808-432f-4925-928d-796b5bc36ac9) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:16.845615 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.846162 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:16.846609 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:16.848639 np0000000669 nova-compute[97951]: INFO os_vif [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:02:55,bridge_name='br-int',has_traffic_filtering=True,id=55e9c21b-9829-40e1-98cc-037540f69e41,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e9c21b-98')
May 13 04:25:16.848961 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Deleting instance files /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400_del
May 13 04:25:16.849997 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Deletion of /opt/stack/data/nova/instances/bb3874f1-4ceb-4a94-9d9e-e388fb6a3400_del complete
May 13 04:25:17.095501 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:17.098086 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:17.115394 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.116375 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.116763 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.117630 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.119585 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.119585 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:25:17.359572 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 04:25:17.360286 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:17.360716 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:17.360847 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:17.361134 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:17.471758 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:17.607314 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:25:17.607758 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646317.607407, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:17.607758 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Paused (Lifecycle Event)
May 13 04:25:17.628886 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Took 7.34 seconds to spawn the instance on the hypervisor.
May 13 04:25:17.628886 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:17.823113 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:17.823879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:17.824090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:17.826418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:17.827012 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:17.827253 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received unexpected event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with vm_state active and task_state None.
May 13 04:25:17.827446 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-deleted-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:17.827566 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Neutron deleted interface 55e9c21b-9829-40e1-98cc-037540f69e41; detaching it from the instance and deleting it from the info cache
May 13 04:25:17.827669 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:18.115848 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:18.118780 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646318.1178112, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:18.118780 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Resumed (Lifecycle Event)
May 13 04:25:18.138788 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Took 13.99 seconds to build instance.
May 13 04:25:18.249511 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:18.249726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] Acquiring lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:18.250040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:18.250398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:18.250398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] No waiting events found dispatching network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:18.250588 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5a78526-1bd3-4dea-97cf-43f85b9a7ee2 req-7e4baf6b-74f3-448f-b9a0-00914e244f78 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Received event network-vif-unplugged-55e9c21b-9829-40e1-98cc-037540f69e41 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:18.264199 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:18.334994 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4a7dc23-24bd-4ee5-bdbf-f3c1171d1992 req-d1879edf-b4e6-49f5-bd0f-9874cbb16c85 service nova] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Detach interface failed, port_id=55e9c21b-9829-40e1-98cc-037540f69e41, reason: Instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:25:18.620151 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:18.622212 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:18.640301 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.496s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:18.765969 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Took 1.41 seconds to deallocate network for instance.
May 13 04:25:19.270861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:19.271047 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:19.635270 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:19.635640 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:20.064215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:20.064823 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:20.099345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:20.138091 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:20.567714 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:20.644881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.373s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:20.708706 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance bb3874f1-4ceb-4a94-9d9e-e388fb6a3400
May 13 04:25:21.574357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:21.717881 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0bf5bd3b-9c2e-414e-99d9-6ba67146041a tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "bb3874f1-4ceb-4a94-9d9e-e388fb6a3400" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.232s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:21.846929 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:22.667546 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:22.667690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:22.667851 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Attaching volume 0d143aa3-935a-48f8-853f-71455e55c14a to /dev/vdb
May 13 04:25:22.712621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:22.712839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:22.713274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:22.713274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:22.713451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:22.716072 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Terminating instance
May 13 04:25:22.720064 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:22.741974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:25:22.768013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:22.826141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:25:22.826512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:25:22.836448 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:25:22.837835 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe91:450d', 'fe80::fc16:3eff:fe4b:1cad', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:feda:8da5', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fed7:72ba', 'fe80::5ca5:8ff:fecb:35bd', 'fe80::fc16:3eff:fe77:edf4', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd'] 
May 13 04:25:22.837966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:25:22.838100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:25:22.838334 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:22.838623 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating existing volume attachment record: db14edec-ae69-494a-b994-809624e4675f {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:25:23.221883 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:23.243713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:23.253656 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:23.279042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:23.397393 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:23.403447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:25:23.403938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:23.404108 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:23.404654 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:23.406276 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:23.406276 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:25:23.425433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:23.426648 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:23.427272 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:23.430303 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:25:23.436524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:23.436524 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:25:23.447636 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:25:23.447636 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:23.454990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:23.455295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:23.456300 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:23.458844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:23.459017 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] No waiting events found dispatching network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:23.459306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e4615938-fc20-4dd9-8c50-e6e3d6f6ec16 req-c3ce5b34-0985-42c1-b0bc-8ed37c53e71d service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:23.460001 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:25:23.460001 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:23.460930 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646308.4584699, bef8f03b-9d16-489d-904e-04fbce74b056 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:23.461275 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] VM Stopped (Lifecycle Event)
May 13 04:25:23.463598 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.004929034999804571 future=<Future at 0x7a461c785a60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:23.464593 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:23.464802 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.867630501999884 future=<Future at 0x7a463c1345c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:23.464802 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.867528434999713 future=<Future at 0x7a463c1345c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a] added
May 13 04:25:23.467898 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:23.467898 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:23.467898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:25:23.468914 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:25:23.469309 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:25:23.482016 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a] added
May 13 04:25:23.482016 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:25:23.482016 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:23.482016 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:23.482016 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:23.482016 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:23.482016 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:23.482380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:25:23.482484 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0473(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:25:23.482704 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:25:23.600953 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999370060999809 future=<Future at 0x7a463c286480 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:23.604733 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Instance destroyed successfully.
May 13 04:25:23.606168 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid e6cd15e9-77cc-41e7-81f9-839b352be4a5 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:23.966318 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7d8a9307-b466-4a02-8503-565dfb105f0e tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: bef8f03b-9d16-489d-904e-04fbce74b056] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:24.110507 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='multiattach-server-0',id=40,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsjid5sN8QrGnZXbwwLWVJGPH8gQG51RgK4AXV7iWASPZGPQNUu/c588Eeyz/Vr3+UTZI5ecf0HLaQOAr6x1adn8NLat1UdmwmUJF4JBID1lOfZRKiN/y+eZbjBIsuHg==',key_name='tempest-keypair-769968000',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:20:18Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-hw12xryi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=e6cd15e9-77cc-41e7-81f9-839b352be4a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:24.110860 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "address": "fa:16:3e:77:ed:f4", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap24eb43dc-ba", "ovs_interfaceid": "24eb43dc-ba2c-41e4-8456-3af494301b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:24.111419 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:24.111692 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:24.114114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.114114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24eb43dc-ba, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:24.114499 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.116354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:24.116602 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.117491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.117755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42dc0b29-4676-4582-9ca2-338707056a37) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:24.118345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.119056 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:24.119845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:24.121488 np0000000669 nova-compute[97951]: INFO os_vif [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=24eb43dc-ba2c-41e4-8456-3af494301b3d,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24eb43dc-ba')
May 13 04:25:24.121758 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Deleting instance files /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5_del
May 13 04:25:24.122464 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Deletion of /opt/stack/data/nova/instances/e6cd15e9-77cc-41e7-81f9-839b352be4a5_del complete
May 13 04:25:24.469825 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:25:24.483654 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:25:24.488773 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:25:24.488773 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:25:24.504758 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:25:24.504758 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.518833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.526006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.542348 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:24.554030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.554030 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.554030 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.554030 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.554030 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.554030 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:24.554490 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.554490 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.554490 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.554490 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.554490 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.554490 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:24.586038 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.50.100,3260]
May 13 04:25:24.586038 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.50.100,3260] successful.
May 13 04:25:24.586038 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.604150 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.40.100,3260]
May 13 04:25:24.604150 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.40.100,3260] successful.
May 13 04:25:24.604150 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.604735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.619991 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.627515 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.627915 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:24.628336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:24.628515 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:25:24.630478 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('12', '-', '-', 0) found on session 155 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:25:24.630813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:25:24.637270 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 04:25:24.638070 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:24.638598 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:24.638709 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:24.639617 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.640716 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:24.641000 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:24.641260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:24.641460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:25:24.642993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] HCTL ('13', '-', '-', 0) found on session 156 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:25:24.643146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:25:24.652064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 155 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:25:24.652309 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:25:24.660961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Searching for a device in session 156 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:25:24.660961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:25:24.760029 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:25.102310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:25.427201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:25:25.519107 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:25.519107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] Acquiring lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:25.519406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:25.519406 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:25.519637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] No waiting events found dispatching network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:25.519637 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-unplugged-24eb43dc-ba2c-41e4-8456-3af494301b3d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:25.521938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Received event network-vif-deleted-24eb43dc-ba2c-41e4-8456-3af494301b3d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:25.522110 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Neutron deleted interface 24eb43dc-ba2c-41e4-8456-3af494301b3d; detaching it from the instance and deleting it from the info cache
May 13 04:25:25.522272 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:25.555621 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:26.027479 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-72244200-bd6c-4679-ae1c-129068b007f2 req-5405bdbb-69e9-475b-8d32-8a94f442a99c service nova] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Detach interface failed, port_id=24eb43dc-ba2c-41e4-8456-3af494301b3d, reason: Instance e6cd15e9-77cc-41e7-81f9-839b352be4a5 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:25:26.057668 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Took 1.42 seconds to deallocate network for instance.
May 13 04:25:26.447737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found WWN 330000000e712bfbd for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:25:26.448131 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:26.448131 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000e712bfbd', 'path': '/dev/dm-6', 'multipath_id': '330000000e712bfbd'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:26.448131 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e712bfbd', 'path': '/dev/dm-6', 'multipath_id': '330000000e712bfbd'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:25:26.450873 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:26.565509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:26.565755 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:26.943842 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:26.944053 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:26.954607 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Attempting to attach volume 0d143aa3-935a-48f8-853f-71455e55c14a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:25:26.956293 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:   <alias name="ua-0d143aa3-935a-48f8-853f-71455e55c14a"/>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:   <serial>0d143aa3-935a-48f8-853f-71455e55c14a</serial>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]: </disk>
May 13 04:25:26.956293 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:25:27.080552 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:27.081091 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:25:27.083920 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:27.083920 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:27.446588 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:27.590865 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:27.955148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.389s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:27.957069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.366s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:27.957374 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:27.957661 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:25:28.019571 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance e6cd15e9-77cc-41e7-81f9-839b352be4a5
May 13 04:25:28.622440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:28.622854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:28.622854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:28.622854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] No VIF found with MAC fa:16:3e:da:8d:a5, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:25:28.990414 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.040169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c849608c-8611-4cf1-a388-cee7da1235f0 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "e6cd15e9-77cc-41e7-81f9-839b352be4a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.327s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:29.098079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.098575 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.121358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:29.214279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.219347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:25:29.220669 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:25:29.222516 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.328786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.329438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.447089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.447631 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:25:29.451704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.545966 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.546468 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.652730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.659855 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:25:29.661430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:29.718306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:25:29.718306 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12304MB free_disk=72.74186706542969GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:25:29.718306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:29.718306 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:30.104497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.226653 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63173653-4e40-434b-923c-dff13681a34c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.559s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:30.335738 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:30.335912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:30.336096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:30.339057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:30.339057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:30.339057 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Terminating instance
May 13 04:25:30.792129 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4f08cf99-2921-4750-b4fb-061177a12469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:25:30.792501 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 4b31b39a-956e-4428-9251-2f50db0eba9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:25:30.792501 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 6264bd46-a20d-42b4-a876-169ea74fde0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:25:30.792501 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:25:30.792501 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:25:30.792905 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:25:30.792905 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:25:29 up 39 min,  2 users,  load average: 6.02, 7.41, 5.34\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_a9b631412fa14c72bc60d0fae2cec50a': '1', 'io_workload': '0', 'num_proj_39efcc41639747809d8c2d84bdee24c5': '2', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_proj_15233deb57f94a479979c054d80e15cd': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:25:30.841906 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:30.863312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.866065 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.888108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.892700 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.908065 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:30.917500 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.041402 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:31.041646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:31.041857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:31.042043 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:31.042269 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] No waiting events found dispatching network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:31.042482 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8c2f6fb6-4993-40dd-a98e-3ef407306622 req-6253cebc-eeae-42d5-8902-9816daeaec14 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:31.140224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:31.140714 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:31.198128 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999710736999987 future=<Future at 0x7a4648509160 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:31.199915 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Instance destroyed successfully.
May 13 04:25:31.202806 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lazy-loading 'resources' on Instance uuid 4f08cf99-2921-4750-b4fb-061177a12469 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:31.332885 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00046334700027728104 future=<Future at 0x7a463c1345c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:31.333940 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:31.334154 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.266165002999969 future=<Future at 0x7a463c286480 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:31.334234 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.266037979999965 future=<Future at 0x7a463c286480 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:31.337346 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Emitting event <LifecycleEvent: 1778646316.3322809, bb3874f1-4ceb-4a94-9d9e-e388fb6a3400 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:31.337346 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] VM Stopped (Lifecycle Event)
May 13 04:25:31.344977 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:31.346231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing instance network info cache due to event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:31.346766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:31.347600 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:31.348352 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:31.643993 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:31.706785 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-735773375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-attachvolumemultiattachtest-server-735773375',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:19:59Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b631412fa14c72bc60d0fae2cec50a',ramdisk_id='',reservation_id='r-gfd4kwov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1762651840',owner_user_name='tempest-AttachVolumeMultiAttachTest-1762651840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:20:00Z,user_data=None,user_id='7bf5682626aa450f922f2e02bfc18ddc',uuid=4f08cf99-2921-4750-b4fb-061177a12469,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:31.706985 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converting VIF {"id": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "address": "fa:16:3e:d7:72:ba", "network": {"id": "2a6d3870-d79e-4547-984a-7da5422040b6", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-719851514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9b631412fa14c72bc60d0fae2cec50a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63301e2e-3b", "ovs_interfaceid": "63301e2e-3bf0-4642-a9ba-fc3fd73e5086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:31.707593 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:31.707801 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:31.709150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.709507 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63301e2e-3b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:31.710694 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.711719 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:31.713726 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.714757 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.715481 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28d74c0c-eafb-40f1-99a3-d499d3388ebf) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:31.716029 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:31.717522 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:31.720694 np0000000669 nova-compute[97951]: INFO os_vif [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086,network=Network(2a6d3870-d79e-4547-984a-7da5422040b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63301e2e-3b')
May 13 04:25:31.768792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:25:31.769128 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:31.769441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:31.769784 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:31.770079 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2aa4a007-f72e-4014-913c-ea798a6792db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:25:31.770214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:31.794244 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db (non-flash)
May 13 04:25:31.794722 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e3a44a-e2f4-4e20-b54b-b876a81aa51c', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:25:31.794722 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '87')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:25:31.795678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db', '88')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:25:31.796699 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648517240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:25:31.796896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:25:31.797134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Flush multipath device 3300000009902ebb1 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:25:31.847209 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: bb3874f1-4ceb-4a94-9d9e-e388fb6a3400] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:31.853290 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:31.861652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:25:31.914419 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:25:31.974214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:25:31.974455 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:25:31.976785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:25:31.991118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:25:31.991880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:25:32.004614 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.048656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.40.100,3260]
May 13 04:25:32.048656 np0000000669 nova-compute[97951]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.40.100,3260] successful.
May 13 04:25:32.048656 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.066139 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.079171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.117365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.50.100,3260]
May 13 04:25:32.117365 np0000000669 nova-compute[97951]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-2aa4a007-f72e-4014-913c-ea798a6792db, portal: 192.168.50.100,3260] successful.
May 13 04:25:32.117365 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.132825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:32.133029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:32.133164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] <== disconnect_volume: return (363ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:32.133276 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:25:32.133603 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Deleting instance files /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469_del
May 13 04:25:32.134108 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Deletion of /opt/stack/data/nova/instances/4f08cf99-2921-4750-b4fb-061177a12469_del complete
May 13 04:25:32.152823 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:25:32.152964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.436s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:32.153351 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:25:32.225946 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:32.373971 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updated VIF entry in instance network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:25:32.374277 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:32.558411 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:32.558774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:32.639945 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Took 1.80 seconds to destroy the instance on the hypervisor.
May 13 04:25:32.640780 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:32.641202 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:32.641342 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:32.641711 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:32.708551 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:32.876458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1f1987f5-93df-4e44-ae4a-8dba7f02930e req-590c8656-6b2e-4519-9ed9-009ed7e65a3b service nova] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:32.958266 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba21ec87-7c8a-41ff-90e2-d1198d9536c9 req-8cb8c773-e5f6-44aa-bba5-1f5f91d77fdd service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-deleted-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:32.958266 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ba21ec87-7c8a-41ff-90e2-d1198d9536c9 req-8cb8c773-e5f6-44aa-bba5-1f5f91d77fdd service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Neutron deleted interface 63301e2e-3bf0-4642-a9ba-fc3fd73e5086; detaching it from the instance and deleting it from the info cache
May 13 04:25:32.958266 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ba21ec87-7c8a-41ff-90e2-d1198d9536c9 req-8cb8c773-e5f6-44aa-bba5-1f5f91d77fdd service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:33.062470 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:33.116042 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:33.116386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] Acquiring lock "4f08cf99-2921-4750-b4fb-061177a12469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:33.116802 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:33.117079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] Lock "4f08cf99-2921-4750-b4fb-061177a12469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:33.117339 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] No waiting events found dispatching network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:33.117781 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1c5f91d8-bd01-44a2-84ec-997446409cac req-6819a655-85a7-4351-9daf-c2a0370ae239 service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Received event network-vif-unplugged-63301e2e-3bf0-4642-a9ba-fc3fd73e5086 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:33.393273 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:33.393408 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing instance network info cache due to event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:33.393590 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:33.393636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:33.393729 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:33.408880 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:33.461913 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ba21ec87-7c8a-41ff-90e2-d1198d9536c9 req-8cb8c773-e5f6-44aa-bba5-1f5f91d77fdd service nova] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Detach interface failed, port_id=63301e2e-3bf0-4642-a9ba-fc3fd73e5086, reason: Instance 4f08cf99-2921-4750-b4fb-061177a12469 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:25:33.896817 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:33.912921 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Took 1.27 seconds to deallocate network for instance.
May 13 04:25:34.069729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:34.154909 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.155061 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.155396 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.156522 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.156776 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.157037 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:25:34.157145 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:25:34.157362 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.92 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:25:34.227085 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:34.367727 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updated VIF entry in instance network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:25:34.368084 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:34.472498 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:25:34.869955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4b16b6a8-2025-40bc-acb1-421b2028e84d req-3ae7516c-001f-48df-b73f-30406afbf099 service nova] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:34.976899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:34.976899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:35.117446 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:35.155182 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:35.155409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:35.155605 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Attaching volume d85d5b41-ebc9-4850-a326-93ca379b19d0 to /dev/vdb
May 13 04:25:35.196949 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:35.211602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:25:35.233402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:35.280109 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:25:35.280502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:25:35.291135 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:25:35.292470 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe91:450d', 'fe80::fc16:3eff:fe4b:1cad', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:feda:8da5', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd'] 
May 13 04:25:35.292704 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:25:35.292894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:25:35.293186 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:35.293492 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating existing volume attachment record: cee077e5-2a94-40a3-9c7e-e7b33f76a704 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:25:35.317192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:35.317460 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:35.820989 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:35.843767 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:25:35.844144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:35.844282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:35.844671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:35.845102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:25:35.856840 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:35.857391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:35.858072 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:35.858250 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:25:35.858557 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:35.858725 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:25:35.871459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:25:35.871459 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:35.880191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:25:35.880191 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:35.889119 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0] added
May 13 04:25:35.889119 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:25:35.889119 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:35.889119 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:35.889119 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:35.889119 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:35.889119 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:35.889465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:25:35.889465 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:25:35.889788 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:25:35.895095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0] added
May 13 04:25:35.895095 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:25:35.895095 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:35.895095 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:35.895095 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:25:35.895095 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:25:35.895095 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:35.895294 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:25:35.895414 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:25:35.895542 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:25:36.327388 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.351s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:36.369176 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Deleted allocations for instance 4f08cf99-2921-4750-b4fb-061177a12469
May 13 04:25:36.717185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:36.889945 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:25:36.896211 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:25:36.908529 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:25:36.908529 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:25:36.919693 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:25:36.919693 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:36.928026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:36.936715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:36.948772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.948772 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.948772 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.948772 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.948772 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:36.948974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.948974 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.948974 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.948974 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.948974 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:36.957211 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:36.991853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.50.100,3260]
May 13 04:25:36.991853 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.50.100,3260] successful.
May 13 04:25:36.991853 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:36.997980 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.40.100,3260]
May 13 04:25:36.997980 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.40.100,3260] successful.
May 13 04:25:36.997980 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:37.004214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:37.010745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.024078 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.026858 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:37.026858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.027928 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:37.028849 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] HCTL ('7', '-', '-', 0) found on session 157 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:37.029182 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:37.029426 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:25:37.031103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:37.031390 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:25:37.032257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] HCTL ('8', '-', '-', 0) found on session 158 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:25:37.032445 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:25:37.045036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching for a device in session 157 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:25:37.045036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:25:37.050100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Searching for a device in session 158 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:25:37.050100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:25:37.379798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d8182c45-8b8c-46c4-a156-114e27f0c546 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Lock "4f08cf99-2921-4750-b4fb-061177a12469" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.044s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:37.858578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:25:38.600771 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000471795000066777 future=<Future at 0x7a463c286480 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:38.601470 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646323.6001716, e6cd15e9-77cc-41e7-81f9-839b352be4a5 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:38.601663 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:38.601978 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] VM Stopped (Lifecycle Event)
May 13 04:25:38.602673 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.595125416999963 future=<Future at 0x7a4648509160 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:38.602813 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=7.595003522999832 future=<Future at 0x7a4648509160 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:38.874558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found WWN 3300000006fc17025 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:25:38.874788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:38.874867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000006fc17025', 'path': '/dev/dm-0', 'multipath_id': '3300000006fc17025'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:38.875059 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006fc17025', 'path': '/dev/dm-0', 'multipath_id': '3300000006fc17025'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:25:38.877937 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:39.105441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-b6bbf712-8269-44a9-8ab6-2c2dfc28e152 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e6cd15e9-77cc-41e7-81f9-839b352be4a5] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:39.380506 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Attempting to attach volume d85d5b41-ebc9-4850-a326-93ca379b19d0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:25:39.382157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:   <alias name="ua-d85d5b41-ebc9-4850-a326-93ca379b19d0"/>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:   <serial>d85d5b41-ebc9-4850-a326-93ca379b19d0</serial>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]: </disk>
May 13 04:25:39.382157 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:25:39.461622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:40.096187 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:25:40.130859 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:41.020878 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:41.021004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:41.021057 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:25:41.021176 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] No VIF found with MAC fa:16:3e:91:45:0d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:25:41.717385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:42.585844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73e34780-42c6-493b-9d22-15c0cb8402c1 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.430s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:45.134295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:45.162170 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:45.162396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:45.162532 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Rebooting instance
May 13 04:25:45.732212 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:45.732315 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:45.732467 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:25:45.938985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:45.938985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:46.198746 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.000903937000202859 future=<Future at 0x7a4648509160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:46.199127 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] Emitting event <LifecycleEvent: 1778646331.1977243, 4f08cf99-2921-4750-b4fb-061177a12469 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:46.199249 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:46.199515 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] VM Stopped (Lifecycle Event)
May 13 04:25:46.234945 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:46.440869 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Detaching volume d85d5b41-ebc9-4850-a326-93ca379b19d0
May 13 04:25:46.480950 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Attempting to driver detach volume d85d5b41-ebc9-4850-a326-93ca379b19d0 from mountpoint /dev/vdb
May 13 04:25:46.491518 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found disk vdb by alias ua-d85d5b41-ebc9-4850-a326-93ca379b19d0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:25:46.493655 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Found disk vdb by alias ua-d85d5b41-ebc9-4850-a326-93ca379b19d0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:25:46.493655 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Attempting to detach device vdb from instance 6264bd46-a20d-42b4-a876-169ea74fde0a from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:25:46.493854 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <alias name="ua-d85d5b41-ebc9-4850-a326-93ca379b19d0"/>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <serial>d85d5b41-ebc9-4850-a326-93ca379b19d0</serial>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]: </disk>
May 13 04:25:46.493854 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:25:46.499643 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully detached device vdb from instance 6264bd46-a20d-42b4-a876-169ea74fde0a from the persistent domain config.
May 13 04:25:46.499801 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] (1/8): Attempting to detach device vdb with device alias ua-d85d5b41-ebc9-4850-a326-93ca379b19d0 from instance 6264bd46-a20d-42b4-a876-169ea74fde0a from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:25:46.500054 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <alias name="ua-d85d5b41-ebc9-4850-a326-93ca379b19d0"/>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <serial>d85d5b41-ebc9-4850-a326-93ca379b19d0</serial>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]: </disk>
May 13 04:25:46.500054 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:25:46.598862 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:46.702226 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-02635573-996e-4f33-8948-3530a93063c3 tempest-TestVolumeBackupRestore-1213215852 tempest-TestVolumeBackupRestore-1213215852-project-member] [instance: 4f08cf99-2921-4750-b4fb-061177a12469] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:46.718717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:46.755084 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:47.021169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646347.020768, 6264bd46-a20d-42b4-a876-169ea74fde0a => ua-d85d5b41-ebc9-4850-a326-93ca379b19d0> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:25:47.021610 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d85d5b41-ebc9-4850-a326-93ca379b19d0 for instance 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:25:47.024626 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully detached device vdb from instance 6264bd46-a20d-42b4-a876-169ea74fde0a from the live domain config.
May 13 04:25:47.025928 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:25:47.026244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:47.026415 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:25:47.257065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:47.682273 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:47.761331 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:47.979806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.953s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:25:47.980146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd85d5b41-ebc9-4850-a326-93ca379b19d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:25:47.980308 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:25:48.008651 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0 (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:25:48.009054 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '161')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:25:48.009054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', '158')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:25:48.009951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0', '157')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:25:48.010731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c2e93a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'): ({'sdb'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:25:48.010896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:25:48.011113 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Flush multipath device 3300000006fc17025 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:25:48.050748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:25:48.095968 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:25:48.149922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:25:48.150091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:25:48.151062 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:25:48.162433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:25:48.162646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:25:48.175851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.211195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.40.100,3260]
May 13 04:25:48.211195 np0000000669 nova-compute[97951]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.40.100,3260] successful.
May 13 04:25:48.211195 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.226836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.240007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.279523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.50.100,3260]
May 13 04:25:48.279523 np0000000669 nova-compute[97951]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-d85d5b41-ebc9-4850-a326-93ca379b19d0, portal: 192.168.50.100,3260] successful.
May 13 04:25:48.279523 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.294493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:25:48.294745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:25:48.294860 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] <== disconnect_volume: return (1268ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:48.294983 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:25:48.854192 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'flavor' on Instance uuid 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:49.578690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:49.579121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:49.862250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-01605bf1-510a-488a-ab2a-bd6ae5a2f9e5 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.924s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:49.936620 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:49.936741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing instance network info cache due to event network-changed-ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:49.936894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] Acquiring lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:49.937626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] Acquired lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:49.937825 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Refreshing network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:50.080779 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:25:50.136917 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:50.439764 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:50.449147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:50.449372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:50.449598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:50.449819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:50.449998 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:50.452196 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Terminating instance
May 13 04:25:50.631248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:50.631583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:50.635269 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:25:50.635457 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Claim successful on node np0000000669
May 13 04:25:50.718414 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:50.863473 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updated VIF entry in instance network info cache for port ce17d644-1137-47bc-aa59-2bc9c2f78124. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:25:50.863822 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating instance_info_cache with network_info: [{"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:50.955320 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:25:50.987763 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:50.990115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.015781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.104252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.111803 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.129755 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:51.131249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:51.131353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:51.131457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:51.131572 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] No waiting events found dispatching network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:51.131962 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-757b344e-cb2c-4a55-9107-616686c2dacf req-48e9c9ab-196d-46bd-a013-256f63d77396 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:51.248119 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.250476 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.273831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.277216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.298980 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.308512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.317122 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999677477000205 future=<Future at 0x7a463c77d0d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:51.317999 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998800082000344 future=<Future at 0x7a463c77d0d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:51.318180 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998582161000286 future=<Future at 0x7a463c77d0d0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:51.319421 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Instance destroyed successfully.
May 13 04:25:51.320283 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'resources' on Instance uuid 6264bd46-a20d-42b4-a876-169ea74fde0a {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:25:51.365656 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33b84976-e572-4ea0-ae75-be82262ab446 req-f8520c0f-2f84-4da2-92a9-c67abaaf5dd8 service nova] Releasing lock "refresh_cache-6264bd46-a20d-42b4-a876-169ea74fde0a" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:51.570089 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999628907999977 future=<Future at 0x7a461c7115b0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:25:51.721198 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.789115 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance shutdown successfully.
May 13 04:25:51.824781 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-177546076',display_name='tempest-TestStampPattern-server-177546076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-177546076',id=60,image_ref='55a8dfe7-a25e-48d8-a6b2-bdea3d4ebc01',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:24:53Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-0out8mo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b31b39a-956e-4428-9251-2f50db0eba9b',image_min_disk='1',image_min_ram='0',image_owner_id='39efcc41639747809d8c2d84bdee24c5',image_owner_project_name='tempest-TestStampPattern-2044631915',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2044631915-project-member',image_user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:24:53Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=6264bd46-a20d-42b4-a876-169ea74fde0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:25:51.825030 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "address": "fa:16:3e:91:45:0d", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce17d644-11", "ovs_interfaceid": "ce17d644-1137-47bc-aa59-2bc9c2f78124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:25:51.825639 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:25:51.825904 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:25:51.827209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.827455 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce17d644-11, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:51.828447 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.829446 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:51.835302 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.835912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.836080 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c442818e-8840-4ebe-8b4d-6b14cbb1be77) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:25:51.836744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.837355 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:25:51.842579 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:51.844994 np0000000669 nova-compute[97951]: INFO os_vif [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:45:0d,bridge_name='br-int',has_traffic_filtering=True,id=ce17d644-1137-47bc-aa59-2bc9c2f78124,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce17d644-11')
May 13 04:25:51.845412 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Deleting instance files /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a_del
May 13 04:25:51.846191 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Deletion of /opt/stack/data/nova/instances/6264bd46-a20d-42b4-a876-169ea74fde0a_del complete
May 13 04:25:51.894608 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:51.894874 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:51.991352 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:51.991509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:51.991633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:51.991769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:51.991886 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:51.992101 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received unexpected event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with vm_state active and task_state reboot_started.
May 13 04:25:51.992457 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:51.992589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:51.992729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:51.992843 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:51.992955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:51.993050 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-06c63341-4196-49ec-8c70-986a7f0e4623 req-4f53eea0-dde2-499a-bf43-f1d59cd4bf54 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received unexpected event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with vm_state active and task_state reboot_started.
May 13 04:25:52.187410 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.214600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.217456 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.319151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.353803 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 04:25:52.354511 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:25:52.357351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:25:52.357351 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:25:52.357351 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:52.398523 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:52.456608 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:52.536939 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.541616 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.544764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.546459 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.567815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:52.913309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.282s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:52.915031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:25:53.036331 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Removed pending STOPPED event for e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 due to new event <LifecycleEvent: 1778646353.0358381, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Resumed> {{(pid=97951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 04:25:53.036915 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646353.0358381, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:53.037071 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Resumed (Lifecycle Event)
May 13 04:25:53.039697 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance running successfully.
May 13 04:25:53.040358 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance soft rebooted successfully.
May 13 04:25:53.040494 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:53.184269 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:53.185057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] Acquiring lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:53.185350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:53.185490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:53.185703 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] No waiting events found dispatching network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:53.185807 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4d494e33-6101-4af3-b12f-8d5fc59cc9d1 req-7d14946f-2d88-4987-a6c0-c036865c522e service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-unplugged-ce17d644-1137-47bc-aa59-2bc9c2f78124 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:25:53.219301 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:53.422922 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:25:53.427266 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:25:53.427468 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:25:53.427791 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:53.428610 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:53.541259 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:53.543498 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:53.547807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-03a930a3-f130-476e-afc5-6b7f599b5c53 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.385s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:53.561734 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:25:53.724761 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Took 1.37 seconds to deallocate network for instance.
May 13 04:25:53.925607 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:25:54.049477 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646354.0477793, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:25:54.049477 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Started (Lifecycle Event)
May 13 04:25:54.054877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:54.056195 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:54.060863 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:54.062784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:54.063311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:54.063509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:54.063739 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:54.063968 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received unexpected event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with vm_state active and task_state None.
May 13 04:25:54.064349 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:54.064510 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:54.064658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:54.064779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:54.064900 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:25:54.065003 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received unexpected event network-vif-plugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with vm_state active and task_state None.
May 13 04:25:54.065229 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2917de0f-44ca-4e44-8353-8ef35bec2c2c req-bf1411a3-5b62-4ae8-a43c-8bb1f71c0f59 service nova] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Received event network-vif-deleted-ce17d644-1137-47bc-aa59-2bc9c2f78124 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:54.082088 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Successfully created port: 4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:25:54.231815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:54.232029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:54.433939 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Booting with volume snapshot bda6fe32-3a7c-451b-a2fa-4c8c95262422 at /dev/vda
May 13 04:25:54.557996 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:25:54.562034 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:25:54.565441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:25:54.699537 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:54.699880 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:54.707857 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Successfully updated port: 4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:25:54.762910 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-changed-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:54.764174 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Refreshing instance network info cache due to event network-changed-4ec1f1d8-8e51-4329-846b-6c0974692a23. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:54.764174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] Acquiring lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:54.764174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] Acquired lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:54.764174 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Refreshing network info cache for port 4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:25:55.111988 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:25:55.138270 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:55.205706 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:55.212078 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:55.268420 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:55.365746 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:25:55.517879 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:55.713786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.482s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:55.715467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.604s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:25:55.718863 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:25:55.719033 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Claim successful on node np0000000669
May 13 04:25:55.800998 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Deleted allocations for instance 6264bd46-a20d-42b4-a876-169ea74fde0a
May 13 04:25:56.020342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5134098c-8075-480b-8b9f-fed662af6012 req-997fddb2-0082-4e24-8b7f-eaeb90f0cefa service nova] Releasing lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:56.020682 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:56.020842 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:25:56.588145 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:25:56.749967 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:56.812767 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c96d41ba-7273-4f1c-89a6-a7a2edaa76f7 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "6264bd46-a20d-42b4-a876-169ea74fde0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.363s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:56.838553 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:25:56.946271 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating instance_info_cache with network_info: [{"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:25:57.089116 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:25:57.089116 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:25:57.448386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:25:57.448572 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance network_info: |[{"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:25:57.591474 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:25:57.956871 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:25:57.968754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:25:57.992356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:25:58.037027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:25:58.037396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:25:58.045686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:25:58.047137 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe4b:1cad', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:feda:8da5', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd'] 
May 13 04:25:58.047289 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:25:58.047467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:25:58.047890 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:25:58.048278 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating existing volume attachment record: 88c4fb84-5fd1-4782-bd8e-b87cffc61aeb {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:25:58.100941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.385s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:25:58.101270 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:25:58.607013 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:25:58.607319 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:25:58.607493 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:58.607739 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:25:58.729717 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afa31cf63007403ea6d80e122efc2875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167111e8ee884d88be88fab30aaa43d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:25:59.110733 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:25:59.224735 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Successfully created port: 1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:25:59.613768 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:25:59.712852 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Successfully updated port: 1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:25:59.764432 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-changed-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:25:59.764635 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Refreshing instance network info cache due to event network-changed-1dc72fd7-bd9e-4017-accf-8629b6ff9823. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:25:59.764784 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] Acquiring lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:25:59.764944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] Acquired lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:25:59.765006 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Refreshing network info cache for port 1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:00.117603 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Booting with volume 86a1ffc0-5128-4f38-95e0-458cd7c9687e at /dev/vda
May 13 04:26:00.140214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:00.154209 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:00.164413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:26:00.168038 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:26:00.169022 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:26:00.169233 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Creating image(s)
May 13 04:26:00.169621 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:26:00.169742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Ensure instance console log exists: /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:26:00.170020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:00.170076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:00.170211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:00.170751 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Start _get_guest_xml network_info=[{"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-13T04:25:46Z,direct_url=<?>,disk_format='raw',id=936d4755-d096-41b0-a0db-907c7e537e6a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-808206089',owner='740f7c9f5d174dbab93ae09d1cad017d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-13T04:25:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '467bb706-644d-4a79-bacb-8b3725999926', 'attached_at': '', 'detached_at': '', 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'serial': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13'}, 'disk_bus': 'virtio', 'attachment_id': '88c4fb84-5fd1-4782-bd8e-b87cffc61aeb', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:26:00.174579 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:26:00.175729 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-172052628', uuid='467bb706-644d-4a79-bacb-8b3725999926'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='936d4755-d096-41b0-a0db-907c7e537e6a', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646360.1753938) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:26:00.177259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:26:00.177710 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:26:00.178727 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:26:00.179148 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:26:00.179983 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:26:00.180534 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-13T04:25:46Z,direct_url=<?>,disk_format='raw',id=936d4755-d096-41b0-a0db-907c7e537e6a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-808206089',owner='740f7c9f5d174dbab93ae09d1cad017d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-13T04:25:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:26:00.180684 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:26:00.180777 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:26:00.180892 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:26:00.180995 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:26:00.181089 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:26:00.181236 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:26:00.181371 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:26:00.181494 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:26:00.181593 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:26:00.181706 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:26:00.190232 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:00.206526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:26:00.207458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:00.207846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:00.208794 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:00.209251 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:26:00.217179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:00.221090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:00.221714 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:00.221892 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:26:00.223016 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:00.223993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:00.223993 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:26:00.235138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:26:00.235138 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:00.237190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:26:00.237190 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:00.237860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:26:00.238110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:26:00.254721 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13] added
May 13 04:26:00.254721 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:26:00.254721 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:00.254721 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:00.254721 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:00.254721 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:00.254721 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:00.255018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:26:00.255138 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:26:00.255294 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:26:00.256160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13] added
May 13 04:26:00.256160 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:26:00.256160 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:00.256160 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:00.256160 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:00.256160 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:00.256160 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:00.256370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:26:00.256620 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:26:00.256822 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:26:00.258120 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:26:00.260330 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe4b:1cad', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:feda:8da5', 'fe80::acc7:11ff:fe64:1dac', 'fe80::fc16:3eff:fe9c:c343', 'fe80::58e2:ff:feeb:a8cd'] 
May 13 04:26:00.260533 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:26:00.260699 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:26:00.260994 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:00.261232 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Updating existing volume attachment record: 0e3b21cc-e689-4ab5-948c-d9b5bf9ee80c {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:26:00.268046 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:00.340242 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:26:00.458343 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:00.475268 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-changed-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:00.476094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing instance network info cache due to event network-changed-859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:00.476573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] Acquiring lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:00.476573 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] Acquired lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:00.476757 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Refreshing network info cache for port 859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:00.963788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c0b7514a-add8-4b3d-b82f-d3d20000268c req-0ceb740b-5212-4563-8e03-deb95eb139ee service nova] Releasing lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:00.964216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquired lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:00.964216 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:26:00.979519 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:00.990729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:00.990905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:00.991079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:00.991786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:00.991925 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:00.993869 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Terminating instance
May 13 04:26:01.256164 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:01.257970 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:26:01.258849 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:26:01.271042 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:26:01.271042 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:26:01.278356 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:26:01.278356 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.284974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.290975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.300862 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:01.306168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.306168 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.306168 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.306168 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.306168 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:01.306378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.306378 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.306378 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.306378 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.306378 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:01.337610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.40.100,3260]
May 13 04:26:01.337610 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.40.100,3260] successful.
May 13 04:26:01.337610 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.351781 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.50.100,3260]
May 13 04:26:01.351781 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.50.100,3260] successful.
May 13 04:26:01.351781 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.354010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.363941 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.377358 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:01.377358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.378894 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:01.379087 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:01.379360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:01.379522 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:26:01.380689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('7', '-', '-', 0) found on session 163 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:26:01.380689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:26:01.381381 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('8', '-', '-', 0) found on session 164 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:26:01.381635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:26:01.400095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 163 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:26:01.400095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:26:01.400095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 164 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:26:01.400095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:26:01.419677 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updated VIF entry in instance network info cache for port 859b8100-4be4-4174-80a3-19db57823388. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:01.419982 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [{"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:01.497144 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:26:01.529472 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.536605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.553415 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.565884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.583362 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:26:01.594882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.769124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:01.770435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:01.770435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:01.770435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:01.770435 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] No waiting events found dispatching network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:01.770435 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-01d9fa74-5cd1-4a4b-9d6e-84c4532579de req-8fe71878-31ff-4bb4-98bb-85649889c0a0 service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:01.811190 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:01.819101 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.825828 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.840090 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:01.854819 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998850386000413 future=<Future at 0x7a461c7bdf10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:01.857879 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Instance destroyed successfully.
May 13 04:26:01.858206 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lazy-loading 'resources' on Instance uuid 4b31b39a-956e-4428-9251-2f50db0eba9b {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:01.923820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d27513c5-d121-47c8-b308-bb311f116ec2 req-a209febe-9088-4e26-ba9c-529875573c56 service nova] Releasing lock "refresh_cache-4b31b39a-956e-4428-9251-2f50db0eba9b" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:01.961993 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Updating instance_info_cache with network_info: [{"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:02.224080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:26:02.362177 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1829375926',display_name='tempest-TestStampPattern-server-1829375926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-teststamppattern-server-1829375926',id=56,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyLO0T864dO5JvUMXkVbKMtMJn+e0S7Kpmq5B7ojCLD0P538xOsa/X5Ao3cE1Nm7IxMaXDuoBsqxM3epJGHgMWpyDqc9o7eKGmt6heLHAmmev+ce2ruR0dyNtI5FJvDg==',key_name='tempest-TestStampPattern-1438740129',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:23:31Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39efcc41639747809d8c2d84bdee24c5',ramdisk_id='',reservation_id='r-zgn8t1x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2044631915',owner_user_name='tempest-TestStampPattern-2044631915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:24:38Z,user_data=None,user_id='df44e041ec8940e0be0bc8bcd9cc1f4b',uuid=4b31b39a-956e-4428-9251-2f50db0eba9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:26:02.362415 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converting VIF {"id": "859b8100-4be4-4174-80a3-19db57823388", "address": "fa:16:3e:9c:c3:43", "network": {"id": "1f4225fb-2399-4f7c-b0a1-0bad77efa633", "bridge": "br-int", "label": "tempest-TestStampPattern-2020793285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39efcc41639747809d8c2d84bdee24c5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap859b8100-4b", "ovs_interfaceid": "859b8100-4be4-4174-80a3-19db57823388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:02.362903 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:02.363105 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:26:02.364151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.364334 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap859b8100-4b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:02.373372 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:26:02.374221 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:26:02.374453 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Creating image(s)
May 13 04:26:02.374671 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:26:02.374784 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Ensure instance console log exists: /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:26:02.374965 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:02.375106 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:02.375217 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:02.379910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.380672 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:02.380990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.381576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.381701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95a76e05-3fbf-43a0-823b-b2693b1f68c0) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:02.382100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.382586 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:02.382827 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:02.384145 np0000000669 nova-compute[97951]: INFO os_vif [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:c3:43,bridge_name='br-int',has_traffic_filtering=True,id=859b8100-4be4-4174-80a3-19db57823388,network=Network(1f4225fb-2399-4f7c-b0a1-0bad77efa633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap859b8100-4b')
May 13 04:26:02.384434 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Deleting instance files /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b_del
May 13 04:26:02.385100 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Deletion of /opt/stack/data/nova/instances/4b31b39a-956e-4428-9251-2f50db0eba9b_del complete
May 13 04:26:02.463828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Releasing lock "refresh_cache-e4671ad2-dd70-4be4-a1bb-76266b04d972" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:02.464111 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance network_info: |[{"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:26:02.464859 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Start _get_guest_xml network_info=[{"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e4671ad2-dd70-4be4-a1bb-76266b04d972', 'attached_at': '', 'detached_at': '', 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'serial': '86a1ffc0-5128-4f38-95e0-458cd7c9687e'}, 'disk_bus': 'virtio', 'attachment_id': '0e3b21cc-e689-4ab5-948c-d9b5bf9ee80c', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:26:02.469184 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:26:02.470408 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='e4671ad2-dd70-4be4-a1bb-76266b04d972'), owner=OwnerMeta(userid='afa31cf63007403ea6d80e122efc2875', username='tempest-ImageDependencyTests-936758513-project-member', projectid='167111e8ee884d88be88fab30aaa43d5', projectname='tempest-ImageDependencyTests-936758513'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646362.4700167) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:26:02.471746 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:26:02.472045 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:26:02.472981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:26:02.473125 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:26:02.474008 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:26:02.474265 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:26:02.474417 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:26:02.475156 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:26:02.475782 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:26:02.475782 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:26:02.485539 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:26:02.485827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:02.485977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:02.889916 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:26:02.890493 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:26:02.890887 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:26:02.891001 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:26:02.891230 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:02.988692 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:03.254125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 33000000086172bcb for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:26:03.254554 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:03.254641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000086172bcb', 'path': '/dev/dm-0', 'multipath_id': '33000000086172bcb'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:03.254807 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086172bcb', 'path': '/dev/dm-0', 'multipath_id': '33000000086172bcb'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:26:03.255786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.769s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:03.256456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:26:03.263485 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ecf1051b-1681-40f1-92ae-85b095ca1bd2 req-d9900636-05a7-461e-8752-7480e1a8bc1c service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-deleted-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:03.263886 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ecf1051b-1681-40f1-92ae-85b095ca1bd2 req-d9900636-05a7-461e-8752-7480e1a8bc1c service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Neutron deleted interface 859b8100-4be4-4174-80a3-19db57823388; detaching it from the instance and deleting it from the info cache
May 13 04:26:03.264026 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ecf1051b-1681-40f1-92ae-85b095ca1bd2 req-d9900636-05a7-461e-8752-7480e1a8bc1c service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:03.277170 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:03.278060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:03.278596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:03.278835 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:26:03.279465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:03.279654 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:26:03.294816 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:26:03.294816 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:03.304427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:26:03.304427 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:03.313430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e] added
May 13 04:26:03.313430 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:26:03.313430 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:03.313430 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:03.313430 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:03.313430 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:03.313430 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:03.313694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:26:03.313752 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:26:03.313865 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:26:03.316691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e] added
May 13 04:26:03.316691 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:26:03.316691 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:03.316691 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:03.316691 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:26:03.316691 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:26:03.316691 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:03.316958 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:26:03.316958 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:26:03.317004 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:26:03.704645 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:03.762195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-image-snapshot-server-172052628',id=63,image_ref='936d4755-d096-41b0-a0db-907c7e537e6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbKeXCaTnJgjvH3tPuB/gl4KDWwnN/kNGHIcZxtDaJskOiZjg/62et3AmuKMvIaEWa508BN22Y5o4VNcXIofJuwlrdPkssTi0bcleVP2fHirS9hR5aeGjJK5Wjeo/BatA==',key_name='tempest-keypair-2056623022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-aaoxyh8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-722735240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=467bb706-644d-4a79-bacb-8b3725999926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:26:03.762453 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:03.763043 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:03.763798 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 467bb706-644d-4a79-bacb-8b3725999926 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:03.768483 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ecf1051b-1681-40f1-92ae-85b095ca1bd2 req-d9900636-05a7-461e-8752-7480e1a8bc1c service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Detach interface failed, port_id=859b8100-4be4-4174-80a3-19db57823388, reason: Instance 4b31b39a-956e-4428-9251-2f50db0eba9b could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:26:03.821653 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:03.821828 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] Acquiring lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:03.821960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:03.822089 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:03.822196 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] No waiting events found dispatching network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:03.824632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c617cf9a-e38a-4d34-bf60-2d348228c357 req-c59ddc74-e915-4dcd-9c2a-fe9a6aa6cf7e service nova] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Received event network-vif-unplugged-859b8100-4be4-4174-80a3-19db57823388 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:04.206595 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Took 1.32 seconds to deallocate network for instance.
May 13 04:26:04.268879 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] End _get_guest_xml xml=<domain type="qemu">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <uuid>467bb706-644d-4a79-bacb-8b3725999926</uuid>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <name>instance-0000003f</name>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-172052628</nova:name>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:26:00</nova:creationTime>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:diskFormat>raw</nova:diskFormat>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="img_bdm_v2">True</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid=""/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         <nova:port uuid="4ec1f1d8-8e51-4329-846b-6c0974692a23">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <system>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="serial">467bb706-644d-4a79-bacb-8b3725999926</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="uuid">467bb706-644d-4a79-bacb-8b3725999926</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </system>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <os>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </os>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <features>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </features>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   <devices>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/disk.config"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <alias name="ua-7912cb06-e833-42c5-a8d5-8bc6e0c13d13"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <serial>7912cb06-e833-42c5-a8d5-8bc6e0c13d13</serial>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:62:49:f9"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <target dev="tap4ec1f1d8-8e"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </interface>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/console.log" append="off"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </serial>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <video>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </video>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </rng>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:   </devices>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]: </domain>
May 13 04:26:04.268879 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:26:04.272688 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Preparing to wait for external event network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:26:04.272688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:04.272688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:04.272688 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:04.272688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-image-snapshot-server-172052628',id=63,image_ref='936d4755-d096-41b0-a0db-907c7e537e6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbKeXCaTnJgjvH3tPuB/gl4KDWwnN/kNGHIcZxtDaJskOiZjg/62et3AmuKMvIaEWa508BN22Y5o4VNcXIofJuwlrdPkssTi0bcleVP2fHirS9hR5aeGjJK5Wjeo/BatA==',key_name='tempest-keypair-2056623022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-aaoxyh8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-722735240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=467bb706-644d-4a79-bacb-8b3725999926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:26:04.275306 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:04.276381 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:04.276633 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:26:04.276968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.277187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:04.277412 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:26:04.277970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.278094 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc480cdf-614c-5a99-98b1-e30e1219edf0', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:04.278776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.279310 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:04.279556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.281282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.281432 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ec1f1d8-8e, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:04.281701 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ec1f1d8-8e, col_values=(('qos', UUID('2f573bcd-a83a-4a43-89cc-12cd1a52771b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:04.281856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ec1f1d8-8e, col_values=(('external_ids', {'iface-id': '4ec1f1d8-8e51-4329-846b-6c0974692a23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:49:f9', 'vm-uuid': '467bb706-644d-4a79-bacb-8b3725999926'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:04.282437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.283415 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:04.287809 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:04.288601 np0000000669 nova-compute[97951]: INFO os_vif [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e')
May 13 04:26:04.314225 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:26:04.317716 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:26:04.328220 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:26:04.328220 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:26:04.333091 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:26:04.333091 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.343682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.348363 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.356316 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.356558 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.361416 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.361601 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:04.389163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.40.100,3260]
May 13 04:26:04.389163 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.40.100,3260] successful.
May 13 04:26:04.389163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.400073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.50.100,3260]
May 13 04:26:04.400073 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.50.100,3260] successful.
May 13 04:26:04.400073 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.400500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.411405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.419946 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.420151 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:04.420315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:04.420424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:26:04.421286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] HCTL ('11', '-', '-', 0) found on session 165 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:26:04.421432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.426496 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:04.426688 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:04.426867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:04.426982 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:26:04.427712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] HCTL ('14', '-', '-', 0) found on session 166 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:26:04.427838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:26:04.436977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:26:04.438082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:26:04.443868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Searching for a device in session 166 and hctl ['14', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:26:04.712084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:04.712238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:04.957242 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:04.957518 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:05.159135 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:05.442823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Searching for a device in session 166 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:26:05.443222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:26:05.459900 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:05.802933 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:05.803065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:05.803196 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:62:49:f9, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:26:05.803732 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Using config drive
May 13 04:26:05.965870 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.253s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:06.026259 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Deleted allocations for instance 4b31b39a-956e-4428-9251-2f50db0eba9b
May 13 04:26:06.298594 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Found WWN 33000000056a2378f for multipath device dm-7 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:26:06.298834 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:06.299034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] <== connect_volume: return (3813ms) {'type': 'block', 'scsi_wwn': '33000000056a2378f', 'path': '/dev/dm-7', 'multipath_id': '33000000056a2378f'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:06.299170 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000056a2378f', 'path': '/dev/dm-7', 'multipath_id': '33000000056a2378f'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:26:06.308993 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:06.317355 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00032579799972154433 future=<Future at 0x7a463c77d0d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.317355 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.317355 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.25235594300011144 future=<Future at 0x7a461c7115b0 state=cancelled>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.317982 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646351.316694, 6264bd46-a20d-42b4-a876-169ea74fde0a => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:06.318219 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] VM Stopped (Lifecycle Event)
May 13 04:26:06.319734 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.2504480050001803 future=<Future at 0x7a461c7115b0 state=cancelled>) was cancelled while queued, skipping {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.319734 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.319734 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.534088257000349 future=<Future at 0x7a461c7bdf10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.319734 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=10.533994333999999 future=<Future at 0x7a461c7bdf10 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:06.434740 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Creating config drive at /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/disk.config
May 13 04:26:06.438741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0r4ze0ds {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:06.494960 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0r4ze0ds" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:06.813684 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='instance-depend-image',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='167111e8ee884d88be88fab30aaa43d5',ramdisk_id='',reservation_id='r-0c8tchh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-936758513',owner_user_name='tempest-ImageDependencyTests-936758513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:26:00Z,user_data=None,user_id='afa31cf63007403ea6d80e122efc2875',uuid=e4671ad2-dd70-4be4-a1bb-76266b04d972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:26:06.813891 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converting VIF {"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:06.814663 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:06.815556 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lazy-loading 'pci_devices' on Instance uuid e4671ad2-dd70-4be4-a1bb-76266b04d972 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:06.821087 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 6264bd46-a20d-42b4-a876-169ea74fde0a] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:06.906467 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:06.931678 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.026959 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.032544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.033041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.040167 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0ff391d0-5886-413f-8e63-89d0a61669ed tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Lock "4b31b39a-956e-4428-9251-2f50db0eba9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.049s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:07.086191 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-234f191d-9dcd-471f-a0fd-1423026b088f req-cc3263ab-46c1-45b4-90fb-f48b1117d71c service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:07.088066 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-234f191d-9dcd-471f-a0fd-1423026b088f req-cc3263ab-46c1-45b4-90fb-f48b1117d71c service nova] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:07.088296 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-234f191d-9dcd-471f-a0fd-1423026b088f req-cc3263ab-46c1-45b4-90fb-f48b1117d71c service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:07.088525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-234f191d-9dcd-471f-a0fd-1423026b088f req-cc3263ab-46c1-45b4-90fb-f48b1117d71c service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:07.088655 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-234f191d-9dcd-471f-a0fd-1423026b088f req-cc3263ab-46c1-45b4-90fb-f48b1117d71c service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Processing event network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:26:07.318448 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] End _get_guest_xml xml=<domain type="qemu">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <uuid>e4671ad2-dd70-4be4-a1bb-76266b04d972</uuid>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <name>instance-00000040</name>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:name>instance-depend-image</nova:name>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:26:02</nova:creationTime>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:properties/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:user uuid="afa31cf63007403ea6d80e122efc2875">tempest-ImageDependencyTests-936758513-project-member</nova:user>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:project uuid="167111e8ee884d88be88fab30aaa43d5">tempest-ImageDependencyTests-936758513</nova:project>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         <nova:port uuid="1dc72fd7-bd9e-4017-accf-8629b6ff9823">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="192.168.233.134" ipVersion="4"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <system>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="serial">e4671ad2-dd70-4be4-a1bb-76266b04d972</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="uuid">e4671ad2-dd70-4be4-a1bb-76266b04d972</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </system>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <os>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </os>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <features>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </features>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   <devices>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/disk.config"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <alias name="ua-86a1ffc0-5128-4f38-95e0-458cd7c9687e"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-7"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <serial>86a1ffc0-5128-4f38-95e0-458cd7c9687e</serial>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:65:a1:3d"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <target dev="tap1dc72fd7-bd"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </interface>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/console.log" append="off"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </serial>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <video>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </video>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </rng>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:   </devices>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]: </domain>
May 13 04:26:07.318448 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Preparing to wait for external event network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='instance-depend-image',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='167111e8ee884d88be88fab30aaa43d5',ramdisk_id='',reservation_id='r-0c8tchh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-936758513',owner_user_name='tempest-ImageDependencyTests-936758513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:26:00Z,user_data=None,user_id='afa31cf63007403ea6d80e122efc2875',uuid=e4671ad2-dd70-4be4-a1bb-76266b04d972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:26:07.320450 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converting VIF {"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:07.320906 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:07.321158 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:26:07.321451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.321682 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:07.321911 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:26:07.322554 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.322715 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c071ac44-c131-57d4-bc12-9fb8854687c7', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:07.323780 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.324685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:07.324957 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.327155 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.327369 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc72fd7-bd, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:07.327683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dc72fd7-bd, col_values=(('qos', UUID('4af60703-c201-43f2-aefa-37beb8eeed8c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:07.327879 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dc72fd7-bd, col_values=(('external_ids', {'iface-id': '1dc72fd7-bd9e-4017-accf-8629b6ff9823', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:a1:3d', 'vm-uuid': 'e4671ad2-dd70-4be4-a1bb-76266b04d972'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:07.328702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.329922 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:07.333918 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:07.334994 np0000000669 nova-compute[97951]: INFO os_vif [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd')
May 13 04:26:07.776481 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646367.7760086, 467bb706-644d-4a79-bacb-8b3725999926 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:07.777501 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:26:07.777782 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] VM Started (Lifecycle Event)
May 13 04:26:07.780104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:26:07.782239 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance spawned successfully.
May 13 04:26:07.782552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:26:07.788961 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:07.789343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:08.280868 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:08.284737 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:08.295947 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Took 8.13 seconds to spawn the instance on the hypervisor.
May 13 04:26:08.296139 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:08.788700 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:26:08.788700 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646368.7870882, 467bb706-644d-4a79-bacb-8b3725999926 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:08.788700 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] VM Paused (Lifecycle Event)
May 13 04:26:08.808901 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Took 18.22 seconds to build instance.
May 13 04:26:08.858161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:08.858161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:08.858161 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] No VIF found with MAC fa:16:3e:65:a1:3d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:26:08.858161 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Using config drive
May 13 04:26:09.167641 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:09.167982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:09.168094 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:09.168356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:09.168631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] No waiting events found dispatching network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:09.169343 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-04286eeb-4117-4743-8835-5c4c233f9613 req-3ef07fe5-ef7a-470e-a6dc-e09db8ba6bdf service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received unexpected event network-vif-plugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 for instance with vm_state active and task_state None.
May 13 04:26:09.291450 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:09.302434 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646369.300071, 467bb706-644d-4a79-bacb-8b3725999926 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:09.302434 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] VM Resumed (Lifecycle Event)
May 13 04:26:09.310649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-560025ab-53bb-49fa-85d5-fcbf335985e5 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.732s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:09.367846 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:09.510676 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Creating config drive at /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/disk.config
May 13 04:26:09.516240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpssoe3bm_ {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:09.588680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpssoe3bm_" returned: 0 in 0.072s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:09.804760 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:09.811789 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:10.041861 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.106792 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.107493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.109428 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.140371 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-changed-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:10.140371 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Refreshing instance network info cache due to event network-changed-4ec1f1d8-8e51-4329-846b-6c0974692a23. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:10.140371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] Acquiring lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:10.140371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] Acquired lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:10.140371 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Refreshing network info cache for port 4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:10.163186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.168394 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.371028 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.373744 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.376909 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.403312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.403312 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.417456 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10f9e25e-032f-4334-ad8b-bd1d0a7684ea req-2b88519b-6720-4444-9591-da5bde87eb06 service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:10.417456 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10f9e25e-032f-4334-ad8b-bd1d0a7684ea req-2b88519b-6720-4444-9591-da5bde87eb06 service nova] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:10.417456 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10f9e25e-032f-4334-ad8b-bd1d0a7684ea req-2b88519b-6720-4444-9591-da5bde87eb06 service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:10.417456 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10f9e25e-032f-4334-ad8b-bd1d0a7684ea req-2b88519b-6720-4444-9591-da5bde87eb06 service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:10.417456 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10f9e25e-032f-4334-ad8b-bd1d0a7684ea req-2b88519b-6720-4444-9591-da5bde87eb06 service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Processing event network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:26:10.642747 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:10.678649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:10.884938 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:26:10.885693 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646370.8852153, e4671ad2-dd70-4be4-a1bb-76266b04d972 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:10.885919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] VM Started (Lifecycle Event)
May 13 04:26:10.889785 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:26:10.894140 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance spawned successfully.
May 13 04:26:10.894606 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:26:11.006640 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:11.135148 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updated VIF entry in instance network info cache for port 4ec1f1d8-8e51-4329-846b-6c0974692a23. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:11.135743 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating instance_info_cache with network_info: [{"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:11.390215 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:11.392615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:11.404458 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.404672 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.405062 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.405382 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.405732 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.406027 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:11.638055 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-be6b5606-018a-4579-9951-15e938592dbf req-93ab9028-c2e5-4843-9fd5-0fe74a77b326 service nova] Releasing lock "refresh_cache-467bb706-644d-4a79-bacb-8b3725999926" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:11.894958 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:26:11.895306 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646371.8950016, e4671ad2-dd70-4be4-a1bb-76266b04d972 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:11.895306 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] VM Paused (Lifecycle Event)
May 13 04:26:11.914307 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Took 9.54 seconds to spawn the instance on the hypervisor.
May 13 04:26:11.914307 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:12.329784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:12.397788 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:12.401490 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646372.4011564, e4671ad2-dd70-4be4-a1bb-76266b04d972 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:12.401680 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] VM Resumed (Lifecycle Event)
May 13 04:26:12.430733 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Took 17.36 seconds to build instance.
May 13 04:26:12.486420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:12.514027 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:12.514274 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:12.514489 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:12.514667 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:12.514826 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] No waiting events found dispatching network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:12.514999 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9e33179f-ac73-4625-b798-790ce0a7fbbc req-9b5e5055-41b4-4bc5-9c19-d49fb3a651fd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received unexpected event network-vif-plugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 for instance with vm_state active and task_state None.
May 13 04:26:12.904358 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:12.908798 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:12.933515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.878s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:15.163470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:16.854030 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003624289997787855 future=<Future at 0x7a461c7bdf10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:16.854612 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Emitting event <LifecycleEvent: 1778646361.8535795, 4b31b39a-956e-4428-9251-2f50db0eba9b => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:16.854760 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:16.854890 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] VM Stopped (Lifecycle Event)
May 13 04:26:17.299071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:17.299341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:17.299631 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:17.299844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:17.300046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:17.302603 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Terminating instance
May 13 04:26:17.331014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.358121 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-85940eda-eaa2-4a64-9ce5-7e5484ab7ca6 tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: 4b31b39a-956e-4428-9251-2f50db0eba9b] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:17.806348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:26:17.826015 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.833999 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.847872 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.853424 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.873231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:17.996786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:17.997885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:17.997885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:17.997885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:17.997885 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] No waiting events found dispatching network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:17.997885 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c5eebc61-33fc-46a0-bf6f-43ef3a63ebf7 req-5240090d-5e77-46df-a381-64d3db7482bf service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:18.146348 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999728051000147 future=<Future at 0x7a4648420e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:18.146861 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999194739999893 future=<Future at 0x7a4648420e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:18.146948 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999076633000186 future=<Future at 0x7a4648420e30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:18.149946 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Instance destroyed successfully.
May 13 04:26:18.150583 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lazy-loading 'resources' on Instance uuid e4671ad2-dd70-4be4-a1bb-76266b04d972 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:18.653583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='instance-depend-image',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:26:11Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='167111e8ee884d88be88fab30aaa43d5',ramdisk_id='',reservation_id='r-0c8tchh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-936758513',owner_user_name='tempest-ImageDependencyTests-936758513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:26:12Z,user_data=None,user_id='afa31cf63007403ea6d80e122efc2875',uuid=e4671ad2-dd70-4be4-a1bb-76266b04d972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:26:18.653814 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converting VIF {"id": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "address": "fa:16:3e:65:a1:3d", "network": {"id": "71e71bb0-e1c5-41e4-8928-e4b7dba144fb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb27ee19f7a1411896edf4c068d8ad2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc72fd7-bd", "ovs_interfaceid": "1dc72fd7-bd9e-4017-accf-8629b6ff9823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:18.654334 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:18.654559 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:26:18.656623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:18.656623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc72fd7-bd, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:18.657063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:18.658367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:18.659372 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:18.659372 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4af60703-c201-43f2-aefa-37beb8eeed8c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:18.659611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:18.660542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:18.662006 np0000000669 nova-compute[97951]: INFO os_vif [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:3d,bridge_name='br-int',has_traffic_filtering=True,id=1dc72fd7-bd9e-4017-accf-8629b6ff9823,network=Network(71e71bb0-e1c5-41e4-8928-e4b7dba144fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc72fd7-bd')
May 13 04:26:18.663367 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:26:18.663646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:18.663798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:18.664129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:18.664541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86a1ffc0-5128-4f38-95e0-458cd7c9687e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:26:18.664719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:18.688772 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e (non-flash)
May 13 04:26:18.689179 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:18.689524 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '166')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:26:18.689750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '165')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:18.691107 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e', '166')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:18.692209 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c71aca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'): ({'sdi'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:26:18.692542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Removing multipathed devices sdi, sdf {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:26:18.692892 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Flush multipath device 33000000056a2378f {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:26:18.720237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:18.763777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:18.801560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Checking to see if SCSI volumes sdi, sdf have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:26:18.801761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] SCSI volumes sdi, sdf have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:26:18.803247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Checking to see if device paths {'sdi', 'sdf'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:26:18.814931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Device paths {'sdi', 'sdf'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:26:18.815245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:26:18.826798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.865735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.40.100,3260]
May 13 04:26:18.865735 np0000000669 nova-compute[97951]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.40.100,3260] successful.
May 13 04:26:18.865735 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.880884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.890040 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.919316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.50.100,3260]
May 13 04:26:18.919316 np0000000669 nova-compute[97951]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-86a1ffc0-5128-4f38-95e0-458cd7c9687e, portal: 192.168.50.100,3260] successful.
May 13 04:26:18.919316 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.935230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:18.935576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:18.935760 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] <== disconnect_volume: return (272ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:18.935919 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:26:18.936271 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Deleting instance files /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972_del
May 13 04:26:18.936822 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Deletion of /opt/stack/data/nova/instances/e4671ad2-dd70-4be4-a1bb-76266b04d972_del complete
May 13 04:26:19.443444 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Took 1.64 seconds to destroy the instance on the hypervisor.
May 13 04:26:19.443961 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:26:19.444232 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:26:19.444405 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:26:19.444641 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:19.516102 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:20.076267 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] Acquiring lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] No waiting events found dispatching network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-unplugged-1dc72fd7-bd9e-4017-accf-8629b6ff9823 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Received event network-vif-deleted-1dc72fd7-bd9e-4017-accf-8629b6ff9823 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:20.079359 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Neutron deleted interface 1dc72fd7-bd9e-4017-accf-8629b6ff9823; detaching it from the instance and deleting it from the info cache
May 13 04:26:20.080228 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:20.164868 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:20.198428 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:20.584920 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ccaf7965-92b2-48d2-9cfc-a26900e0af53 req-97ba54a7-0b9d-414f-93df-0e34120c50cd service nova] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Detach interface failed, port_id=1dc72fd7-bd9e-4017-accf-8629b6ff9823, reason: Instance e4671ad2-dd70-4be4-a1bb-76266b04d972 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:26:20.700288 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Took 1.26 seconds to deallocate network for instance.
May 13 04:26:21.250654 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:26:21.252500 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Deleting volume: 86a1ffc0-5128-4f38-95e0-458cd7c9687e {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:26:21.795228 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:21.795686 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:22.034511 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:22.034750 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:22.537755 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:23.045931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.250s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:23.120041 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Deleted allocations for instance e4671ad2-dd70-4be4-a1bb-76266b04d972
May 13 04:26:23.660840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:23.779069 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:24.129598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-88769a9a-91b8-411b-8208-b28726221b66 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Lock "e4671ad2-dd70-4be4-a1bb-76266b04d972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.829s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:25.179921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:25.764776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:27.081389 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:27.081765 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:26:27.083696 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:27.084069 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:26:28.083368 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:28.084603 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:28.588867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:28.589114 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:28.589282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:28.589468 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:26:28.662228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:29.613363 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:26:29.614724 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:26:29.616877 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:29.723141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:29.723650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:29.830363 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:29.830919 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:26:29.835645 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:26:29.837197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:29.886404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:29.886826 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13268MB free_disk=72.77186584472656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:26:29.887102 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:29.887413 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:30.094283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:30.181306 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:30.345774 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:30.346080 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing instance network info cache due to event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:30.346187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:30.346303 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:30.346496 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:30.738231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:30.739239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing instance network info cache due to event network-changed-c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:30.739239 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] Acquiring lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:30.848980 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:30.955344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:26:30.955344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:26:30.955344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 467bb706-644d-4a79-bacb-8b3725999926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:26:30.955344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:26:30.955344 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:26:29 up 40 min,  2 users,  load average: 5.20, 6.94, 5.31\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '2', 'io_workload': '0', 'num_proj_15233deb57f94a479979c054d80e15cd': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:26:31.139483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:31.139742 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:31.170273 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:31.283932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:31.284084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:31.310458 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updated VIF entry in instance network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:31.310753 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:31.642492 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:31.786195 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Detaching volume 0d143aa3-935a-48f8-853f-71455e55c14a
May 13 04:26:31.812732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b01ab8b5-ddd6-49ca-b51a-ef6edeab5ae5 req-aacc578b-0bd7-40db-8978-7b63865e3923 service nova] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:31.813391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] Acquired lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:31.813391 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Refreshing network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:31.829996 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Attempting to driver detach volume 0d143aa3-935a-48f8-853f-71455e55c14a from mountpoint /dev/vdb
May 13 04:26:31.834921 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found disk vdb by alias ua-0d143aa3-935a-48f8-853f-71455e55c14a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:26:31.836226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Found disk vdb by alias ua-0d143aa3-935a-48f8-853f-71455e55c14a {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:26:31.836358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Attempting to detach device vdb from instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:26:31.836616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <alias name="ua-0d143aa3-935a-48f8-853f-71455e55c14a"/>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <serial>0d143aa3-935a-48f8-853f-71455e55c14a</serial>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]: </disk>
May 13 04:26:31.836616 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:26:31.842829 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully detached device vdb from instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 from the persistent domain config.
May 13 04:26:31.842979 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] (1/8): Attempting to detach device vdb with device alias ua-0d143aa3-935a-48f8-853f-71455e55c14a from instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:26:31.843172 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <alias name="ua-0d143aa3-935a-48f8-853f-71455e55c14a"/>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-6"/>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <serial>0d143aa3-935a-48f8-853f-71455e55c14a</serial>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]: </disk>
May 13 04:26:31.843172 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:26:32.148417 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:26:32.148547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.261s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:32.148783 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:26:32.315784 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:32.337869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646392.337358, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => ua-0d143aa3-935a-48f8-853f-71455e55c14a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:26:32.339229 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0d143aa3-935a-48f8-853f-71455e55c14a for instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:26:32.341892 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully detached device vdb from instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 from the live domain config.
May 13 04:26:32.342985 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:26:32.343333 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:32.343514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:32.570293 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:32.686815 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updated VIF entry in instance network info cache for port c62e4f9b-9483-4521-b01f-972b5b41cb2d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:32.687146 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [{"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:33.146761 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00048123499982466456 future=<Future at 0x7a4648420e30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:33.147209 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:33.148375 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Emitting event <LifecycleEvent: 1778646378.145958, e4671ad2-dd70-4be4-a1bb-76266b04d972 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:33.148497 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] VM Stopped (Lifecycle Event)
May 13 04:26:33.189515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-eda53dfc-c050-4e47-a7d3-e61f8b105190 req-dcc414bd-6fa2-4210-b679-056d64bb5736 service nova] Releasing lock "refresh_cache-e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:33.651419 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: e4671ad2-dd70-4be4-a1bb-76266b04d972] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:33.663416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:34.147901 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:34.148292 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:34.148292 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:34.148412 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:34.148506 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:26:34.148738 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.93 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:26:35.003923 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.660s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:35.004162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d143aa3-935a-48f8-853f-71455e55c14a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:26:35.004313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:26:35.031448 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:26:35.031756 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:35.031756 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '168')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:26:35.032099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '156')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:35.033317 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a', '155')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:35.034300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c15ab60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:26:35.034577 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Removing multipathed devices sdh, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:26:35.034857 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Flush multipath device 330000000e712bfbd {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:26:35.067693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:35.084658 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:26:35.084936 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:26:35.121766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:35.169940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:26:35.170450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:26:35.171270 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:26:35.183024 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:26:35.183202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:26:35.195207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.198367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:35.232286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.40.100,3260]
May 13 04:26:35.232286 np0000000669 nova-compute[97951]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.40.100,3260] successful.
May 13 04:26:35.232286 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.251111 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.263439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.299076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.50.100,3260]
May 13 04:26:35.299076 np0000000669 nova-compute[97951]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-0d143aa3-935a-48f8-853f-71455e55c14a, portal: 192.168.50.100,3260] successful.
May 13 04:26:35.299076 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.318723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:35.319054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:35.319244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] <== disconnect_volume: return (2975ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:35.319439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:26:35.871398 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'flavor' on Instance uuid e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:36.881317 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b0cc4ede-a232-468f-a8d8-29beb5afd93d tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.597s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:38.664692 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:38.914256 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:38.914444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:38.914639 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:38.914762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:38.915009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:38.917427 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Terminating instance
May 13 04:26:39.420578 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:26:39.438973 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.439564 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.459739 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.465680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.487472 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.492262 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:39.592199 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:39.592346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:39.592517 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:39.592618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:39.593002 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:39.593118 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a718d231-2795-4e98-bd7b-a18d02001aae req-65ab865c-2138-40b0-9cdf-3f7f15cb184f service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:39.742701 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999688027000047 future=<Future at 0x7a4648222b70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:39.743200 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999184632000379 future=<Future at 0x7a4648222b70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:39.743381 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998999071000071 future=<Future at 0x7a4648222b70 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:39.744729 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Instance destroyed successfully.
May 13 04:26:39.745196 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lazy-loading 'resources' on Instance uuid e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:40.214046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.248127 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:25:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148825096',display_name='tempest-TestMinimumBasicScenario-server-148825096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testminimumbasicscenario-server-148825096',id=62,image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYWeyUPxyUrkhqVD6ymjfxi4jKnvFy/TuIQKMBbfyusfwbkOr+dvkWM8wt9Jabkuarlx4QIMxaN8RkdTVQQye3bB0JWrVtvPTuUE6F+9x9OMWxAee5M1XKoVCkDqG1uZQ==',key_name='tempest-TestMinimumBasicScenario-611504227',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:25:17Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15233deb57f94a479979c054d80e15cd',ramdisk_id='',reservation_id='r-esnzqb20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='07df39e3-0478-4398-b4a8-449f89d75a5d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1268923831',owner_user_name='tempest-TestMinimumBasicScenario-1268923831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:25:53Z,user_data=None,user_id='9d4e261ef262474d9c74dd8bf2b35d1a',uuid=e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:26:40.248627 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converting VIF {"id": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "address": "fa:16:3e:da:8d:a5", "network": {"id": "ac6a4745-abcd-4202-b658-a27a4f80e869", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1663390104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15233deb57f94a479979c054d80e15cd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc62e4f9b-94", "ovs_interfaceid": "c62e4f9b-9483-4521-b01f-972b5b41cb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:40.249667 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:40.250047 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:26:40.251548 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.251760 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc62e4f9b-94, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:40.253477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.253689 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:40.254756 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.255786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.255931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab554b0b-654a-4af9-a0a7-e579ad97642c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:40.256634 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.257188 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:40.259057 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:40.261115 np0000000669 nova-compute[97951]: INFO os_vif [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:8d:a5,bridge_name='br-int',has_traffic_filtering=True,id=c62e4f9b-9483-4521-b01f-972b5b41cb2d,network=Network(ac6a4745-abcd-4202-b658-a27a4f80e869),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc62e4f9b-94')
May 13 04:26:40.261540 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Deleting instance files /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3_del
May 13 04:26:40.262435 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Deletion of /opt/stack/data/nova/instances/e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3_del complete
May 13 04:26:40.770226 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Took 1.35 seconds to destroy the instance on the hypervisor.
May 13 04:26:40.770959 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:26:40.771413 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:26:40.771505 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:26:40.771741 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:40.871530 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:41.161941 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b1328502-40c3-4f74-9995-f2b534964586 req-f4c57c0e-a8a1-44bc-8f29-a7898c8d54ec service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-deleted-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:41.164727 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-b1328502-40c3-4f74-9995-f2b534964586 req-f4c57c0e-a8a1-44bc-8f29-a7898c8d54ec service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Neutron deleted interface c62e4f9b-9483-4521-b01f-972b5b41cb2d; detaching it from the instance and deleting it from the info cache
May 13 04:26:41.164727 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b1328502-40c3-4f74-9995-f2b534964586 req-f4c57c0e-a8a1-44bc-8f29-a7898c8d54ec service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:41.616036 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:41.670736 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b1328502-40c3-4f74-9995-f2b534964586 req-f4c57c0e-a8a1-44bc-8f29-a7898c8d54ec service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Detach interface failed, port_id=c62e4f9b-9483-4521-b01f-972b5b41cb2d, reason: Instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:26:41.671649 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:41.671775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] Acquiring lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:41.671939 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:41.672053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:41.672145 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] No waiting events found dispatching network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:41.672522 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5f1e3cb7-bb65-45da-9a12-caf2cb6270ac req-a1ebbcb5-d76e-499d-b08b-4a8e9fb2a438 service nova] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Received event network-vif-unplugged-c62e4f9b-9483-4521-b01f-972b5b41cb2d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:42.117964 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Took 1.35 seconds to deallocate network for instance.
May 13 04:26:42.624012 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:42.624012 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:42.798449 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:42.798636 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:43.301020 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:43.421713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:43.421918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:43.808705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.185s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:43.852192 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Deleted allocations for instance e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3
May 13 04:26:43.923551 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:26:44.474402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:44.474860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:44.477675 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:26:44.477820 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Claim successful on node np0000000669
May 13 04:26:44.862540 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-77e5144f-cfa2-4a9a-87e6-3c087ba7425c tempest-TestMinimumBasicScenario-1268923831 tempest-TestMinimumBasicScenario-1268923831-project-member] Lock "e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.948s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:45.225108 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:45.257487 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:45.649038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:45.649038 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:46.152280 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:46.664058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.189s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:46.664612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:26:47.142576 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:47.170647 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:26:47.170851 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:26:47.171156 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:47.171446 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:47.364383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:47.364383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:47.364518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:47.364691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:47.364862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:47.367341 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Terminating instance
May 13 04:26:47.385476 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb359d584a0b41398ca70e7e57fd589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7988aac1411045f0b97e046631509aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:26:47.673531 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:26:47.709866 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:47.870743 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:26:47.886702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:47.888052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:47.890588 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Successfully created port: 7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:26:47.913003 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.025461 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.031925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.102766 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:48.103146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:48.103346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:48.103495 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:48.103626 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] No waiting events found dispatching network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:48.103735 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-023afc37-95b5-4838-b813-e5b7db8c78a8 req-65010567-6309-4a39-9836-e691346fce38 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:48.176553 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:26:48.183976 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.191413 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.208820 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999676747000194 future=<Future at 0x7a4648249a30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:48.213035 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Instance destroyed successfully.
May 13 04:26:48.214923 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 467bb706-644d-4a79-bacb-8b3725999926 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:48.667613 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Successfully updated port: 7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:26:48.717515 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-172052628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-image-snapshot-server-172052628',id=63,image_ref='936d4755-d096-41b0-a0db-907c7e537e6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbKeXCaTnJgjvH3tPuB/gl4KDWwnN/kNGHIcZxtDaJskOiZjg/62et3AmuKMvIaEWa508BN22Y5o4VNcXIofJuwlrdPkssTi0bcleVP2fHirS9hR5aeGjJK5Wjeo/BatA==',key_name='tempest-keypair-2056623022',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:26:08Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-aaoxyh8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-722735240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=467bb706-644d-4a79-bacb-8b3725999926,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:26:48.718001 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "address": "fa:16:3e:62:49:f9", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec1f1d8-8e", "ovs_interfaceid": "4ec1f1d8-8e51-4329-846b-6c0974692a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:48.718421 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:48.718707 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:26:48.719920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.719920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ec1f1d8-8e, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:48.722854 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.723746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:48.724687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.724863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f573bcd-a83a-4a43-89cc-12cd1a52771b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:48.726153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.726153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:48.726153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:48.729102 np0000000669 nova-compute[97951]: INFO os_vif [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:49:f9,bridge_name='br-int',has_traffic_filtering=True,id=4ec1f1d8-8e51-4329-846b-6c0974692a23,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec1f1d8-8e')
May 13 04:26:48.730194 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:26:48.730512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:48.730674 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:48.731021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:48.731412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:26:48.731804 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:26:48.757472 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:48.757472 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:48.757472 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:48.757472 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:48.757472 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:48.757694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:48.757694 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:48.757694 np0000000669 nova-compute[97951]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:48.757694 np0000000669 nova-compute[97951]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13 (non-flash)
May 13 04:26:48.757694 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:48.757789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '164')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:26:48.757952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '163')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:48.759056 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13', '164')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:48.760052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c707ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:26:48.760373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:26:48.760625 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 33000000086172bcb {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:26:48.820020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:48.862053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:48.905857 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:26:48.906036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:26:48.906953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:26:48.920174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:26:48.920396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:26:48.935129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:48.969604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.40.100,3260]
May 13 04:26:48.969604 np0000000669 nova-compute[97951]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.40.100,3260] successful.
May 13 04:26:48.969604 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:48.982876 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:48.994941 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:49.031355 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.50.100,3260]
May 13 04:26:49.031355 np0000000669 nova-compute[97951]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-7912cb06-e833-42c5-a8d5-8bc6e0c13d13, portal: 192.168.50.100,3260] successful.
May 13 04:26:49.031355 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:49.046138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:49.046138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:49.046369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (315ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:49.046756 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:26:49.047034 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Deleting instance files /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926_del
May 13 04:26:49.047597 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Deletion of /opt/stack/data/nova/instances/467bb706-644d-4a79-bacb-8b3725999926_del complete
May 13 04:26:49.169909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:49.170026 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquired lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:49.170169 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:26:49.185302 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:26:49.187652 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:26:49.187968 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Creating image(s)
May 13 04:26:49.188746 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:49.188953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:49.189788 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:49.190299 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:26:49.193665 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:26:49.195409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:49.304775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.109s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:49.305420 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:49.305979 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:49.306470 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:26:49.310196 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:26:49.310661 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:49.409273 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.098s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:49.409942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:49.436121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:49.488423 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk 1073741824" returned: 0 in 0.078s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:49.488948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:49.489298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:49.559553 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Took 1.69 seconds to destroy the instance on the hypervisor.
May 13 04:26:49.566346 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:26:49.566739 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:26:49.566923 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:26:49.567375 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:49.581057 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:49.581497 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:26:49.581747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:49.662637 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:49.683003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:49.683400 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Cannot resize image /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:26:49.683740 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:26:49.683891 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Ensure instance console log exists: /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:26:49.684133 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:49.684398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:49.684505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:49.744124 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:26:49.939196 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:50.113241 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating instance_info_cache with network_info: [{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:50.226880 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:50.298069 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:50.298341 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Acquiring lock "467bb706-644d-4a79-bacb-8b3725999926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:50.299206 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:50.299390 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Lock "467bb706-644d-4a79-bacb-8b3725999926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:50.299586 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] No waiting events found dispatching network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:50.299746 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-unplugged-4ec1f1d8-8e51-4329-846b-6c0974692a23 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:26:50.299899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-changed-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:50.300042 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Refreshing instance network info cache due to event network-changed-7de34297-24ef-401e-b9ab-79d32947bb08. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:50.300233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Acquiring lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:50.597789 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:50.617192 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Releasing lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:50.617515 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Instance network_info: |[{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:26:50.617992 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Acquired lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:50.618228 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Refreshing network info cache for port 7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:50.620583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Start _get_guest_xml network_info=[{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:26:50.625722 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:26:50.627430 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1581098954', uuid='7e31fa23-4a02-45c3-a5f7-ea015178b2e4'), owner=OwnerMeta(userid='cb359d584a0b41398ca70e7e57fd589f', username='tempest-TestEncryptedCinderVolumes-1387017513-project-member', projectid='7988aac1411045f0b97e046631509aac', projectname='tempest-TestEncryptedCinderVolumes-1387017513'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646410.626944) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:26:50.629073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:26:50.629695 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:26:50.630934 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:26:50.631104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:26:50.632223 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:26:50.632580 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:26:50.632913 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:26:50.633007 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:26:50.633117 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:26:50.633227 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:26:50.633352 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:26:50.633534 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:26:50.633676 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:26:50.633819 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:26:50.633924 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:26:50.634031 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:26:50.644167 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1581098954',display_name='tempest-TestEncryptedCinderVolumes-server-1581098954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1581098954',id=65,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBnGY+2JGj3TjAcABhZflcjHEwrFmHh7TUc4ed0G67mb1cByaaFhHdItMV5523rf9Gb9byXxTxCkRwKRqh28pe8hur1hO7ZTUl7NDILJSULiPO5RqS7ibQvukcX1kxLpg==',key_name='tempest-keypair-675825021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-lmzc9mgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=7e31fa23-4a02-45c3-a5f7-ea015178b2e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:26:50.644413 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:50.645016 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:50.645694 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:51.099598 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Took 1.53 seconds to deallocate network for instance.
May 13 04:26:51.121761 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:51.148561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] End _get_guest_xml xml=<domain type="qemu">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <uuid>7e31fa23-4a02-45c3-a5f7-ea015178b2e4</uuid>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <name>instance-00000041</name>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1581098954</nova:name>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:26:50</nova:creationTime>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:user uuid="cb359d584a0b41398ca70e7e57fd589f">tempest-TestEncryptedCinderVolumes-1387017513-project-member</nova:user>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:project uuid="7988aac1411045f0b97e046631509aac">tempest-TestEncryptedCinderVolumes-1387017513</nova:project>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         <nova:port uuid="7de34297-24ef-401e-b9ab-79d32947bb08">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <system>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="serial">7e31fa23-4a02-45c3-a5f7-ea015178b2e4</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="uuid">7e31fa23-4a02-45c3-a5f7-ea015178b2e4</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </system>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <os>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </os>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <features>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </features>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   <devices>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.config"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </disk>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:0c:3b:48"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <target dev="tap7de34297-24"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </interface>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/console.log" append="off"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </serial>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <video>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </video>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </rng>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:   </devices>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]: </domain>
May 13 04:26:51.148561 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Preparing to wait for external event network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1581098954',display_name='tempest-TestEncryptedCinderVolumes-server-1581098954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1581098954',id=65,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBnGY+2JGj3TjAcABhZflcjHEwrFmHh7TUc4ed0G67mb1cByaaFhHdItMV5523rf9Gb9byXxTxCkRwKRqh28pe8hur1hO7ZTUl7NDILJSULiPO5RqS7ibQvukcX1kxLpg==',key_name='tempest-keypair-675825021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-lmzc9mgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=7e31fa23-4a02-45c3-a5f7-ea015178b2e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:26:51.150649 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:51.151181 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:51.151500 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:26:51.152145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.152948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:51.152948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:26:51.326147 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.327167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32aa83a9-5690-5a91-9a01-3b762d8ed178', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:51.327845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.328943 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:51.330769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.330923 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7de34297-24, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:51.331313 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7de34297-24, col_values=(('qos', UUID('873386bf-7bd7-4e40-be34-f39caa82809b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:51.331697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7de34297-24, col_values=(('external_ids', {'iface-id': '7de34297-24ef-401e-b9ab-79d32947bb08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:3b:48', 'vm-uuid': '7e31fa23-4a02-45c3-a5f7-ea015178b2e4'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:51.332309 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.333797 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:51.337933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:51.338988 np0000000669 nova-compute[97951]: INFO os_vif [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24')
May 13 04:26:51.586526 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:51.649208 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:26:51.651213 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Deleting volume: 7912cb06-e833-42c5-a8d5-8bc6e0c13d13 {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:26:51.711146 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updated VIF entry in instance network info cache for port 7de34297-24ef-401e-b9ab-79d32947bb08. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:51.712926 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating instance_info_cache with network_info: [{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:52.193559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:52.193894 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:52.214906 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] Releasing lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:26:52.215150 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Received event network-vif-deleted-4ec1f1d8-8e51-4329-846b-6c0974692a23 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:52.215361 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Neutron deleted interface 4ec1f1d8-8e51-4329-846b-6c0974692a23; detaching it from the instance and deleting it from the info cache
May 13 04:26:52.215726 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:52.378393 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:26:52.378589 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:26:52.720982 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-33ef0f85-457d-45df-936a-1f36c9eb1319 req-59bc5c81-76dc-4ed0-ae99-0ea57dbf6786 service nova] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Detach interface failed, port_id=4ec1f1d8-8e51-4329-846b-6c0974692a23, reason: Instance 467bb706-644d-4a79-bacb-8b3725999926 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:26:52.860831 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:52.861041 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:26:52.861177 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No VIF found with MAC fa:16:3e:0c:3b:48, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:26:52.861713 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Using config drive
May 13 04:26:52.881332 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:26:53.191599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:53.367675 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:53.390311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.196s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:53.449223 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 467bb706-644d-4a79-bacb-8b3725999926
May 13 04:26:53.573702 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Creating config drive at /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.config
May 13 04:26:53.577897 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo060ksn0 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:26:53.648923 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo060ksn0" returned: 0 in 0.071s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:26:54.093994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.119425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.214788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.403560 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.405721 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.407856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.432711 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.462995 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-008d3dfc-ae37-4012-a398-2ff94fb59072 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "467bb706-644d-4a79-bacb-8b3725999926" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.099s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:54.562014 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3845c9a1-a84e-4e6f-95aa-d99dc0c9361e req-2c9e939a-cf2b-4ed0-9345-98b3ed350173 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:54.562337 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3845c9a1-a84e-4e6f-95aa-d99dc0c9361e req-2c9e939a-cf2b-4ed0-9345-98b3ed350173 service nova] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:54.562601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3845c9a1-a84e-4e6f-95aa-d99dc0c9361e req-2c9e939a-cf2b-4ed0-9345-98b3ed350173 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:54.562902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3845c9a1-a84e-4e6f-95aa-d99dc0c9361e req-2c9e939a-cf2b-4ed0-9345-98b3ed350173 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:54.563139 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3845c9a1-a84e-4e6f-95aa-d99dc0c9361e req-2c9e939a-cf2b-4ed0-9345-98b3ed350173 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Processing event network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:26:54.743178 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005185820000406238 future=<Future at 0x7a4648222b70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:54.743178 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:54.743311 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=8.465159083999879 future=<Future at 0x7a4648249a30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:54.743379 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=8.46504714799994 future=<Future at 0x7a4648249a30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:54.744049 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646399.7422917, e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:54.744285 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] VM Stopped (Lifecycle Event)
May 13 04:26:54.796622 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:54.987399 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646414.9870265, 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:54.988204 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:26:54.988441 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] VM Started (Lifecycle Event)
May 13 04:26:54.991535 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:26:54.996634 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Instance spawned successfully.
May 13 04:26:54.996947 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:26:55.241153 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:55.247671 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: e1ae6a4c-a060-42ba-9243-5b4efa9cc8c3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:55.492086 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:55.496783 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:55.506549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.506798 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.507144 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.507449 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.507923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.510876 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:26:55.828213 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:56.003284 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:26:56.003502 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646416.003354, 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:56.003602 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] VM Paused (Lifecycle Event)
May 13 04:26:56.018399 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Took 6.83 seconds to spawn the instance on the hypervisor.
May 13 04:26:56.018636 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:56.350666 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:56.509031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:56.512477 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646416.5122235, 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:26:56.512971 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] VM Resumed (Lifecycle Event)
May 13 04:26:56.530355 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Took 12.10 seconds to build instance.
May 13 04:26:56.642768 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:56.643270 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:56.643480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:56.643629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:56.643770 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] No waiting events found dispatching network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:26:56.643871 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-62dc9b30-f434-4411-a760-57d9c82ae1ed req-4a0aef6b-f7c3-4e05-b30b-b457d1290b4e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received unexpected event network-vif-plugged-7de34297-24ef-401e-b9ab-79d32947bb08 for instance with vm_state active and task_state None.
May 13 04:26:56.765543 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:56.765727 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:56.765951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:26:56.766148 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:26:56.766279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:56.768371 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Terminating instance
May 13 04:26:57.015680 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:26:57.018243 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:26:57.034264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3f8d04ba-f179-4c6b-a6fd-6c1bd3a112f0 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.612s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:26:57.276849 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:26:57.297194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:57.300638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:57.325545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:57.329295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:57.353422 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:57.629019 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999671988000046 future=<Future at 0x7a461c6888c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:26:57.632036 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Instance destroyed successfully.
May 13 04:26:57.634059 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:26:57.960873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:58.028313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-changed-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:58.028504 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Refreshing instance network info cache due to event network-changed-7de34297-24ef-401e-b9ab-79d32947bb08. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:26:58.028687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] Acquiring lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:26:58.029090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] Acquired lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:26:58.029235 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Refreshing network info cache for port 7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:26:58.136632 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817065001',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817065001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-volume-backed-server-817065001',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY6j8RZnDrBEsCp71PxgkErTDAXe4mFwsDt+WSI1ymmMkv/h6eB8oZZNhRddt/ilpvaNPP6NGcdR5ZZEbwWYJJ10BB+aKHNjT7ps/LzijOeFDiRcPuGaD4YvYEtBnb0Gg==',key_name='tempest-keypair-2068273764',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:25:06Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-0yhjt9ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=f4022180-db9e-4d9d-903c-9f0c7e8c2cf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:26:58.136904 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "893a21bf-366b-44d1-a678-d03d23bc1db6", "address": "fa:16:3e:4b:1c:ad", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap893a21bf-36", "ovs_interfaceid": "893a21bf-366b-44d1-a678-d03d23bc1db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:26:58.137792 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:26:58.137792 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:26:58.138746 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:58.139091 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap893a21bf-36, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:58.141663 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:58.142335 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:58.142453 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=badda1cc-dbce-4984-90e2-363b5b56fea6) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:26:58.145711 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:26:58.147340 np0000000669 nova-compute[97951]: INFO os_vif [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:1c:ad,bridge_name='br-int',has_traffic_filtering=True,id=893a21bf-366b-44d1-a678-d03d23bc1db6,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893a21bf-36')
May 13 04:26:58.149449 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:26:58.149734 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:26:58.149878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:26:58.150229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:26:58.150523 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7967647-9080-4299-abb1-c3a1e438481c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:26:58.150779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:26:58.173379 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:58.173379 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:58.173379 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:26:58.173526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:58.173526 np0000000669 nova-compute[97951]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c (non-flash)
May 13 04:26:58.173526 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:26:58.173745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:26:58.173830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '152')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:58.174686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c', '151')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:26:58.175588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46481296c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:26:58.175870 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdd, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:26:58.176141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 33000000060927597 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:26:58.237770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:58.298439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:26:58.357639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:26:58.357639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:26:58.357639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:26:58.369913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:26:58.370357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:26:58.382932 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.407871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.40.100,3260]
May 13 04:26:58.407871 np0000000669 nova-compute[97951]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.40.100,3260] successful.
May 13 04:26:58.407871 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.419958 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.431994 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.458341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.50.100,3260]
May 13 04:26:58.458341 np0000000669 nova-compute[97951]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f7967647-9080-4299-abb1-c3a1e438481c, portal: 192.168.50.100,3260] successful.
May 13 04:26:58.458341 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.469090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:26:58.469288 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:26:58.469419 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (319ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:26:58.469524 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:26:58.469764 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Deleting instance files /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2_del
May 13 04:26:58.470341 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Deletion of /opt/stack/data/nova/instances/f4022180-db9e-4d9d-903c-9f0c7e8c2cf2_del complete
May 13 04:26:58.531951 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:58.976559 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Took 1.70 seconds to destroy the instance on the hypervisor.
May 13 04:26:58.977198 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:26:58.977543 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:26:58.977704 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:26:58.977831 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:59.004092 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:59.055711 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:26:59.331546 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:26:59.480035 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updated VIF entry in instance network info cache for port 7de34297-24ef-401e-b9ab-79d32947bb08. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:26:59.480291 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating instance_info_cache with network_info: [{"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:59.584185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c794d2d4-f25a-4261-8c22-8cc0dd6751b9 req-d82cce5e-dd93-4a70-9c58-57dea7001e54 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Received event network-vif-deleted-893a21bf-366b-44d1-a678-d03d23bc1db6 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:26:59.584333 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c794d2d4-f25a-4261-8c22-8cc0dd6751b9 req-d82cce5e-dd93-4a70-9c58-57dea7001e54 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Neutron deleted interface 893a21bf-366b-44d1-a678-d03d23bc1db6; detaching it from the instance and deleting it from the info cache
May 13 04:26:59.584462 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c794d2d4-f25a-4261-8c22-8cc0dd6751b9 req-d82cce5e-dd93-4a70-9c58-57dea7001e54 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:26:59.987209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-041ca97e-bc02-4149-a81e-23f5b336caf3 req-edacdb06-5c12-4b2b-aee0-651fb8ee24c7 service nova] Releasing lock "refresh_cache-7e31fa23-4a02-45c3-a5f7-ea015178b2e4" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:00.012380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:00.027750 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:00.090213 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c794d2d4-f25a-4261-8c22-8cc0dd6751b9 req-d82cce5e-dd93-4a70-9c58-57dea7001e54 service nova] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Detach interface failed, port_id=893a21bf-366b-44d1-a678-d03d23bc1db6, reason: Instance f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:27:00.242648 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:00.531349 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Took 1.55 seconds to deallocate network for instance.
May 13 04:27:01.091152 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:27:01.092990 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Deleting volume: f7967647-9080-4299-abb1-c3a1e438481c {{(pid=97951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 04:27:01.631646 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:01.631799 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:01.780347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:01.780710 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:02.283645 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:02.790084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.158s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:02.843000 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance f4022180-db9e-4d9d-903c-9f0c7e8c2cf2
May 13 04:27:03.162635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:03.208892 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003813429998444917 future=<Future at 0x7a4648249a30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:03.209202 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646408.208373, 467bb706-644d-4a79-bacb-8b3725999926 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:03.209334 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:03.209506 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] VM Stopped (Lifecycle Event)
May 13 04:27:03.211028 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.418179026999951 future=<Future at 0x7a461c6888c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:03.211028 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.418055670000285 future=<Future at 0x7a461c6888c0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:03.712859 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 467bb706-644d-4a79-bacb-8b3725999926] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:03.851916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9d552cb0-e7e0-4115-8cbb-7a6e4684a518 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "f4022180-db9e-4d9d-903c-9f0c7e8c2cf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.086s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:04.268467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:04.268668 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:04.771404 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:27:05.243274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:05.332602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:05.332850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:05.338070 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:27:05.338192 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Claim successful on node np0000000669
May 13 04:27:06.473009 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:06.473401 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:06.975570 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:07.481397 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.148s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:07.481842 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:27:07.988165 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:27:07.988307 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:27:07.988635 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:07.988853 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:08.074735 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9431469bdf974894a3493b27bb04be38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc09d5d69246b19f02313d2f4596e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:27:08.164673 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:08.492195 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:27:08.579102 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Successfully created port: 0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:27:08.961069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:08.961365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:08.995976 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:27:09.081278 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Successfully updated port: 0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:27:09.134631 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-changed-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:09.134850 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Refreshing instance network info cache due to event network-changed-0ba80986-f6be-499e-9b8b-704b524d4b6e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:09.134933 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] Acquiring lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:09.135032 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] Acquired lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:09.135143 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Refreshing network info cache for port 0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:09.463184 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:27:09.500068 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Booting with volume ba8a3db7-cc0b-4e38-a166-c26541be9db9 at /dev/vda
May 13 04:27:09.545764 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:09.559134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:27:09.583530 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:09.596427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:09.636345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:27:09.636345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:27:09.640347 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:09.644542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:27:09.645595 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0c:3b48', 'fe80::b4da:96ff:fe34:f9b4'] 
May 13 04:27:09.645762 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:27:09.645895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:27:09.646171 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:09.646438 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updating existing volume attachment record: a55e9c51-4220-49ee-94d8-29c8c93cd0b5 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:27:09.710317 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:09.856724 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:10.025889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:10.026210 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:10.032394 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:27:10.032618 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Claim successful on node np0000000669
May 13 04:27:10.246186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:10.360024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-58bce6ca-358c-4c4f-ba7e-e77e2f624b97 req-87b1a80f-4e68-4d43-b9ed-56839923419c service nova] Releasing lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:10.360618 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquired lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:10.360810 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:27:10.920244 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:11.102210 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:11.246882 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:11.247051 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:11.259979 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updating instance_info_cache with network_info: [{"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:11.741356 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:27:11.741528 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:27:11.742297 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Creating image(s)
May 13 04:27:11.742297 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:27:11.742297 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Ensure instance console log exists: /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:27:11.742520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:11.743488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:11.743488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:11.749543 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:11.761926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Releasing lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:11.762283 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance network_info: |[{"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:27:11.763203 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Start _get_guest_xml network_info=[{"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '23f383b0-ad1a-4cb1-8afb-d792e9488982', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'serial': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9'}, 'disk_bus': 'virtio', 'attachment_id': 'a55e9c51-4220-49ee-94d8-29c8c93cd0b5', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:27:11.767078 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:27:11.768078 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-2085134616', uuid='23f383b0-ad1a-4cb1-8afb-d792e9488982'), owner=OwnerMeta(userid='9431469bdf974894a3493b27bb04be38', username='tempest-TestVolumeBootPatternV346-1311400665-project-member', projectid='12dc09d5d69246b19f02313d2f4596e0', projectname='tempest-TestVolumeBootPatternV346-1311400665'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646431.7677703) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:27:11.769581 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:27:11.770229 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:27:11.771962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:27:11.771962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:27:11.772088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:27:11.772298 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:27:11.772446 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:27:11.774718 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:27:11.783686 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:27:11.783992 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:11.784120 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:11.784570 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:11.784783 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:27:11.796368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:11.796893 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:11.797493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:11.797726 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:11.798226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:11.798538 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:11.808676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:11.808676 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:11.818426 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:11.818426 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:11.823675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9] added
May 13 04:27:11.823675 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:11.823675 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:11.823675 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:11.823675 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:11.823675 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:11.823675 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:11.823895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:11.824019 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:11.824163 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:11.828997 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9] added
May 13 04:27:11.828997 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:11.828997 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:11.828997 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:11.828997 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:11.828997 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:11.828997 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:11.829245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:11.829581 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:11.829779 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:12.257048 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.231s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:12.257645 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:27:12.629157 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00044245299977774266 future=<Future at 0x7a461c6888c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:12.629593 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] Emitting event <LifecycleEvent: 1778646417.6285675, f4022180-db9e-4d9d-903c-9f0c7e8c2cf2 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:12.629754 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:12.629879 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] VM Stopped (Lifecycle Event)
May 13 04:27:12.762725 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:27:12.762934 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:27:12.763214 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:12.763434 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:12.824821 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:12.830160 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:12.839546 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:12.839546 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:12.845510 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:12.845510 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.849870 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:27:12.858994 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.867663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.873780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.873780 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:12.874008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.874008 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:12.883196 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.883196 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:12.883400 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.883400 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:12.909746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.40.100,3260]
May 13 04:27:12.909746 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.40.100,3260] successful.
May 13 04:27:12.909746 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.922216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:12.937401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.937401 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:12.937401 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:12.937574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:12.937574 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:12.937574 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:12.941676 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:12.941806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:12.942256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('8', '-', '-', 0) found on session 170 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:12.942387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:12.962772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 170 and hctl ['8', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:13.133379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6b41a4f1-ef15-4683-88b9-4f2e0808270e tempest-TestEncryptedCinderVolumes-280722860 tempest-TestEncryptedCinderVolumes-280722860-project-member] [instance: f4022180-db9e-4d9d-903c-9f0c7e8c2cf2] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:13.166963 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:13.267760 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:27:13.329424 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Successfully created port: f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:27:13.772646 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:27:13.814889 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Successfully updated port: f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:27:13.870718 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-changed-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:13.870945 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Refreshing instance network info cache due to event network-changed-f167aecf-f9fa-400f-a359-6551bb70c525. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:13.871133 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] Acquiring lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:13.871254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] Acquired lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:13.871584 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Refreshing network info cache for port f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:13.920487 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.50.100,3260]
May 13 04:27:13.920487 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.50.100,3260] successful.
May 13 04:27:13.920487 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:13.931564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:13.946374 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:13.946374 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:13.946374 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:13.946374 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:13.946754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:13.946754 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:13.946754 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:13.946754 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:13.946954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.150s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:13.947045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:13.947579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('9', '-', '-', 0) found on session 171 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:13.947674 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:13.961034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 170 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:13.961034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:13.961034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 171 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:13.961034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:14.278033 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Booting with volume ec2f50fb-f606-4902-a641-0c9a595d76f5 at /dev/vda
May 13 04:27:14.315494 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:14.318408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:14.330156 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:27:14.358816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:14.375046 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:14.400959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:27:14.401235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:27:14.411413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:27:14.412240 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0c:3b48', 'fe80::b4da:96ff:fe34:f9b4'] 
May 13 04:27:14.412390 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:27:14.412555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:27:14.412831 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:14.413027 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating existing volume attachment record: 3f9aa082-c1e3-4466-875b-fd522eb9216e {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:27:14.446283 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:14.572122 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:14.798658 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:27:15.074217 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-885f082e-e005-4bf7-8d26-6787d19db63c req-24ff73ab-f1c7-44ab-8470-879ea5f9734d service nova] Releasing lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:15.074787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:15.074975 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:27:15.247792 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:15.631666 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:15.776205 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:15.815717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Found WWN 3300000006070652d for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:27:15.816158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.032s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:15.816378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== connect_volume: return (4032ms) {'type': 'block', 'scsi_wwn': '3300000006070652d', 'path': '/dev/dm-0', 'multipath_id': '3300000006070652d'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:15.816556 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006070652d', 'path': '/dev/dm-0', 'multipath_id': '3300000006070652d'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:27:15.904587 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating instance_info_cache with network_info: [{"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:16.324577 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2085134616',display_name='tempest-TestVolumeBootPatternV346-server-2085134616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-2085134616',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaFmMqKwoEutGiMXhEuyO8Lm9sH7g6f5hvgIHimKe/64haMSMDi6oNLvmV4zL27BhyulTlENilGB9xKxyQ5TTKEK/f7HjIS54emKjXjYshSGzXhPEgnSQraUoDlGNbdzg==',key_name='tempest-keypair-1927074232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-lcdl8olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=23f383b0-ad1a-4cb1-8afb-d792e9488982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:27:16.325346 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:16.325578 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:16.326304 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'pci_devices' on Instance uuid 23f383b0-ad1a-4cb1-8afb-d792e9488982 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:16.407946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:16.407946 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance network_info: |[{"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:27:16.505562 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:27:16.506868 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:27:16.507066 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Creating image(s)
May 13 04:27:16.507395 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:27:16.507586 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Ensure instance console log exists: /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:27:16.507937 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:16.508161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:16.508304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:16.508940 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Start _get_guest_xml network_info=[{"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '235d868f-e4d2-4af5-a96f-9e5bc7b3332e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'serial': 'ec2f50fb-f606-4902-a641-0c9a595d76f5'}, 'disk_bus': 'virtio', 'attachment_id': '3f9aa082-c1e3-4466-875b-fd522eb9216e', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:27:16.512442 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:27:16.513837 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-91752006', uuid='235d868f-e4d2-4af5-a96f-9e5bc7b3332e'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646436.5134485) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:27:16.515181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:27:16.515619 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:27:16.517902 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:27:16.518137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:27:16.519257 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:27:16.519631 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:27:16.519810 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:27:16.519949 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:27:16.520130 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:27:16.520272 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:27:16.520445 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:27:16.520685 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:27:16.520838 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:27:16.521008 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:27:16.521175 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:27:16.521426 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:27:16.531803 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:27:16.532095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:16.532235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:16.532529 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:16.532692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:27:16.546631 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:16.547366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:16.547843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:16.548115 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:16.548409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:16.548578 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:16.560077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:16.560077 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:16.564259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:16.564259 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5] added
May 13 04:27:16.572003 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:16.572003 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:16.572003 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:16.575731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5] added
May 13 04:27:16.575731 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:16.575731 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:16.575731 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:16.575731 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:16.575731 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:16.575731 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:16.575947 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:16.576214 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:16.576214 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:16.829055 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] End _get_guest_xml xml=<domain type="qemu">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <uuid>23f383b0-ad1a-4cb1-8afb-d792e9488982</uuid>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <name>instance-00000042</name>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPatternV346-server-2085134616</nova:name>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:27:11</nova:creationTime>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:user uuid="9431469bdf974894a3493b27bb04be38">tempest-TestVolumeBootPatternV346-1311400665-project-member</nova:user>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:project uuid="12dc09d5d69246b19f02313d2f4596e0">tempest-TestVolumeBootPatternV346-1311400665</nova:project>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         <nova:port uuid="0ba80986-f6be-499e-9b8b-704b524d4b6e">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <system>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="serial">23f383b0-ad1a-4cb1-8afb-d792e9488982</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="uuid">23f383b0-ad1a-4cb1-8afb-d792e9488982</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </system>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <os>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </os>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <features>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </features>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   <devices>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/disk.config"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <alias name="ua-ba8a3db7-cc0b-4e38-a166-c26541be9db9"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-0"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <serial>ba8a3db7-cc0b-4e38-a166-c26541be9db9</serial>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:3d:1a:d0"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <target dev="tap0ba80986-f6"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </interface>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/console.log" append="off"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </serial>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <video>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </video>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </rng>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:   </devices>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]: </domain>
May 13 04:27:16.829055 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Preparing to wait for external event network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2085134616',display_name='tempest-TestVolumeBootPatternV346-server-2085134616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-2085134616',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaFmMqKwoEutGiMXhEuyO8Lm9sH7g6f5hvgIHimKe/64haMSMDi6oNLvmV4zL27BhyulTlENilGB9xKxyQ5TTKEK/f7HjIS54emKjXjYshSGzXhPEgnSQraUoDlGNbdzg==',key_name='tempest-keypair-1927074232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-lcdl8olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=23f383b0-ad1a-4cb1-8afb-d792e9488982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.832409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b1384e8-47df-563d-b361-08e8626674db', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:16.833074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.833710 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:16.834144 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.835687 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.836665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ba80986-f6, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:16.836665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ba80986-f6, col_values=(('qos', UUID('65b75484-0fab-4008-886a-528f25457295')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:16.836665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ba80986-f6, col_values=(('external_ids', {'iface-id': '0ba80986-f6be-499e-9b8b-704b524d4b6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:1a:d0', 'vm-uuid': '23f383b0-ad1a-4cb1-8afb-d792e9488982'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:16.837383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.838261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:16.841924 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:16.842607 np0000000669 nova-compute[97951]: INFO os_vif [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6')
May 13 04:27:17.572313 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:17.576680 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:17.585896 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:17.585896 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:17.592011 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:17.592011 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.597780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.603864 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.610013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.610013 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.610013 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.610013 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:17.610193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.610193 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.610193 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.610193 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:17.616816 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.616816 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.616816 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.616816 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:17.616967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.616967 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.616967 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.616967 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:17.638700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260]
May 13 04:27:17.638700 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260] successful.
May 13 04:27:17.638700 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.648961 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.657497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260]
May 13 04:27:17.657497 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260] successful.
May 13 04:27:17.657497 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.667851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.667851 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.667851 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.667851 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.667851 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.667851 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:17.668029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.668029 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.668029 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.668029 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.668029 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.668029 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:17.668264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:17.668460 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:17.668775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:17.669538 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('10', '-', '-', 0) found on session 172 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:17.669641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:17.684633 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.684633 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.684633 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.684633 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.684633 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.684633 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:17.684936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6971a466-cfac-4cbf-80c9-cc5cccf1dcf8 (non-flash)
May 13 04:27:17.684936 np0000000669 nova-compute[97951]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.684936 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:17.684936 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.684936 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:17.684936 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:17.685059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:17.685734 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:17.685734 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 172 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:17.685734 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:17.687217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('11', '-', '-', 0) found on session 173 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:17.687393 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:17.700761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 173 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:17.700761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:18.358181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:18.358526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:18.358569 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No VIF found with MAC fa:16:3e:3d:1a:d0, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:27:18.358973 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Using config drive
May 13 04:27:18.548807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:27:18.865345 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:18.978611 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Creating config drive at /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/disk.config
May 13 04:27:18.983816 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx068jo1 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:19.040414 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx068jo1" returned: 0 in 0.056s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:19.449078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.471749 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.560644 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.567313 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 330000000c37cdf2a for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:27:19.567954 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:19.568281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000c37cdf2a', 'path': '/dev/dm-3', 'multipath_id': '330000000c37cdf2a'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:19.568547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c37cdf2a', 'path': '/dev/dm-3', 'multipath_id': '330000000c37cdf2a'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:27:19.679294 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-211d4520-7a17-4a35-bbd9-95d6a750a435 req-e40dc779-05b7-4b44-8ab0-b95fe7a8d011 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:19.679633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-211d4520-7a17-4a35-bbd9-95d6a750a435 req-e40dc779-05b7-4b44-8ab0-b95fe7a8d011 service nova] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:19.679886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-211d4520-7a17-4a35-bbd9-95d6a750a435 req-e40dc779-05b7-4b44-8ab0-b95fe7a8d011 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:19.680073 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-211d4520-7a17-4a35-bbd9-95d6a750a435 req-e40dc779-05b7-4b44-8ab0-b95fe7a8d011 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:19.680252 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-211d4520-7a17-4a35-bbd9-95d6a750a435 req-e40dc779-05b7-4b44-8ab0-b95fe7a8d011 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Processing event network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:27:19.757801 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.759815 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.763708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.765651 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:19.784074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.080715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91752006',display_name='tempest-TestVolumeBootPattern-server-91752006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-91752006',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-7qg693uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:14Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=235d868f-e4d2-4af5-a96f-9e5bc7b3332e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:27:20.081609 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:20.081951 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:20.083118 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 235d868f-e4d2-4af5-a96f-9e5bc7b3332e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:20.222479 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646440.2220893, 23f383b0-ad1a-4cb1-8afb-d792e9488982 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:20.223019 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:27:20.223202 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] VM Started (Lifecycle Event)
May 13 04:27:20.226893 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:27:20.228796 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance spawned successfully.
May 13 04:27:20.229038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:27:20.249910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.586521 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <uuid>235d868f-e4d2-4af5-a96f-9e5bc7b3332e</uuid>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <name>instance-00000043</name>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-91752006</nova:name>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:27:16</nova:creationTime>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         <nova:port uuid="f167aecf-f9fa-400f-a359-6551bb70c525">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <system>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="serial">235d868f-e4d2-4af5-a96f-9e5bc7b3332e</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="uuid">235d868f-e4d2-4af5-a96f-9e5bc7b3332e</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </system>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <os>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </os>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <features>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </features>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   <devices>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/disk.config"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <alias name="ua-ec2f50fb-f606-4902-a641-0c9a595d76f5"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <serial>ec2f50fb-f606-4902-a641-0c9a595d76f5</serial>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:06:82:e4"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <target dev="tapf167aecf-f9"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </interface>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/console.log" append="off"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </serial>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <video>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </video>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </rng>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:   </devices>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]: </domain>
May 13 04:27:20.586521 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Preparing to wait for external event network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91752006',display_name='tempest-TestVolumeBootPattern-server-91752006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-91752006',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-7qg693uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:14Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=235d868f-e4d2-4af5-a96f-9e5bc7b3332e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:27:20.588920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.589781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:20.589781 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:27:20.590399 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.590655 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e46887c7-1cf2-59d9-844e-c75f7b62ab37', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:20.600068 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.600860 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:20.600965 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.603073 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.603333 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf167aecf-f9, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:20.603686 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf167aecf-f9, col_values=(('qos', UUID('f910a8e4-7072-43d6-98ff-254888d4eca4')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:20.603868 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf167aecf-f9, col_values=(('external_ids', {'iface-id': 'f167aecf-f9fa-400f-a359-6551bb70c525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:82:e4', 'vm-uuid': '235d868f-e4d2-4af5-a96f-9e5bc7b3332e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:20.604619 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.605726 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:20.611434 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:20.612278 np0000000669 nova-compute[97951]: INFO os_vif [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9')
May 13 04:27:20.725781 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:20.727910 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:20.734948 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:20.735106 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:20.735336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:20.735639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:20.735839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:20.736063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:21.230170 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:27:21.230550 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646441.230239, 23f383b0-ad1a-4cb1-8afb-d792e9488982 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:21.230801 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] VM Paused (Lifecycle Event)
May 13 04:27:21.242512 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Took 9.50 seconds to spawn the instance on the hypervisor.
May 13 04:27:21.242738 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:21.733014 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:21.741036 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646441.7408144, 23f383b0-ad1a-4cb1-8afb-d792e9488982 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:21.741146 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] VM Resumed (Lifecycle Event)
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] No waiting events found dispatching network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:21.757444 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-3de7ee78-b722-4219-aaa2-e13f0f192892 req-61d9bd54-0415-493c-9ba3-b8810fc53155 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received unexpected event network-vif-plugged-0ba80986-f6be-499e-9b8b-704b524d4b6e for instance with vm_state active and task_state None.
May 13 04:27:21.758295 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Took 16.48 seconds to build instance.
May 13 04:27:22.127476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:22.127718 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:22.127718 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:06:82:e4, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:27:22.128010 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Using config drive
May 13 04:27:22.243309 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:22.245018 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:22.260838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-52f5e588-9c8f-476e-bd64-ac5a5f7fc736 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.992s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:22.633239 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:22.767703 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Creating config drive at /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/disk.config
May 13 04:27:22.771280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb0789_cy {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:22.847550 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb0789_cy" returned: 0 in 0.076s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:23.264161 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.286282 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.353988 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-changed-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:23.354499 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Refreshing instance network info cache due to event network-changed-0ba80986-f6be-499e-9b8b-704b524d4b6e. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:23.354913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] Acquiring lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:23.354913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] Acquired lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:23.355068 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Refreshing network info cache for port 0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:23.396030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.468037 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-faea934b-3e25-47f2-8b50-69ab61770bbb req-8f79d6e6-1309-4647-bd54-7b5d5cbe200b service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:23.468334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-faea934b-3e25-47f2-8b50-69ab61770bbb req-8f79d6e6-1309-4647-bd54-7b5d5cbe200b service nova] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:23.468541 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-faea934b-3e25-47f2-8b50-69ab61770bbb req-8f79d6e6-1309-4647-bd54-7b5d5cbe200b service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:23.468946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-faea934b-3e25-47f2-8b50-69ab61770bbb req-8f79d6e6-1309-4647-bd54-7b5d5cbe200b service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:23.469094 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-faea934b-3e25-47f2-8b50-69ab61770bbb req-8f79d6e6-1309-4647-bd54-7b5d5cbe200b service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Processing event network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:27:23.604611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.606985 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.610593 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.629788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:23.860454 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:24.082137 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646444.0817864, 235d868f-e4d2-4af5-a96f-9e5bc7b3332e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:24.082288 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] VM Started (Lifecycle Event)
May 13 04:27:24.083763 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:27:24.087055 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:27:24.097434 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance spawned successfully.
May 13 04:27:24.097881 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:27:24.203199 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:24.325135 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updated VIF entry in instance network info cache for port 0ba80986-f6be-499e-9b8b-704b524d4b6e. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:27:24.325346 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updating instance_info_cache with network_info: [{"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:24.585663 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:24.588198 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:24.607759 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.607919 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.608135 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.608435 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.608620 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.608841 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:24.827100 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a5b8c2ec-fbba-434a-a85d-1af864a96cbc req-344da0c8-25e0-4570-801e-15e9417f3392 service nova] Releasing lock "refresh_cache-23f383b0-ad1a-4cb1-8afb-d792e9488982" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:25.090372 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:27:25.090961 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646445.090456, 235d868f-e4d2-4af5-a96f-9e5bc7b3332e => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:25.090961 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] VM Paused (Lifecycle Event)
May 13 04:27:25.113539 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Took 8.61 seconds to spawn the instance on the hypervisor.
May 13 04:27:25.113680 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:25.251733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:25.414626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] No waiting events found dispatching network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:25.533383 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-36a32e73-4f9e-47b5-b22b-3a0b0c92d52e req-07e5ebd5-b037-4469-b609-ca4239473f6e service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received unexpected event network-vif-plugged-f167aecf-f9fa-400f-a359-6551bb70c525 for instance with vm_state active and task_state None.
May 13 04:27:25.593110 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:25.595108 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646445.594936, 235d868f-e4d2-4af5-a96f-9e5bc7b3332e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:25.595215 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] VM Resumed (Lifecycle Event)
May 13 04:27:25.604151 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:25.624599 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Took 15.66 seconds to build instance.
May 13 04:27:26.098467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:26.100270 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:26.125954 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0b654b20-2ae8-4b2d-b536-ecbc87ac542f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.164s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:27.299734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:27.300190 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:27.595908 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-changed-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:27.596031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Refreshing instance network info cache due to event network-changed-f167aecf-f9fa-400f-a359-6551bb70c525. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:27.596181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] Acquiring lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:27.596345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] Acquired lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:27.596562 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Refreshing network info cache for port f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:27.803356 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:27:28.098337 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:28.363648 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:28.364378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:28.367654 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:27:28.367781 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Claim successful on node np0000000669
May 13 04:27:28.379737 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:28.509930 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updated VIF entry in instance network info cache for port f167aecf-f9fa-400f-a359-6551bb70c525. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:27:28.510196 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating instance_info_cache with network_info: [{"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:29.012272 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-13bbabac-9264-43a2-8119-8b3daa7ace08 req-9e287ffc-9d75-43e7-a14d-a175024dcb92 service nova] Releasing lock "refresh_cache-235d868f-e4d2-4af5-a96f-9e5bc7b3332e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:29.079152 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:29.079631 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:29.083478 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:29.083768 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:29.570729 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:29.571231 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:30.073926 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:30.083742 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:30.084119 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:30.084387 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:30.084733 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:30.253932 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:30.582505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:30.582953 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:27:30.590221 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:30.590221 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:30.590221 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:30.590221 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:27:30.609116 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:31.088123 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:27:31.088267 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:27:31.088519 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:31.088709 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:31.166868 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4afc202e8f442f880bee837107aa232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beee2d64aaf4c20b3d265917ef6d0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:27:31.585237 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Successfully created port: dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:27:31.590804 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:27:31.623218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:27:31.626540 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:27:31.634282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:31.726687 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:31.729367 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:31.827146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:31.834190 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:27:31.835859 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:31.890033 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:31.890447 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13286MB free_disk=72.76643753051758GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:27:31.890587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:31.890861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:32.078972 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Successfully updated port: dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:27:32.094901 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:27:32.134692 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-changed-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:32.135072 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Refreshing instance network info cache due to event network-changed-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:32.135265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] Acquiring lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:32.135373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] Acquired lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:32.135488 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Refreshing network info cache for port dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:32.581845 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:32.637440 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:32.704307 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:32.828877 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:32.949577 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:27:32.949715 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 23f383b0-ad1a-4cb1-8afb-d792e9488982 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:27:32.949841 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 235d868f-e4d2-4af5-a96f-9e5bc7b3332e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:27:32.949948 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:27:32.950141 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:27:32.950285 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:27:31 up 41 min,  2 users,  load average: 4.20, 6.37, 5.22\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_7988aac1411045f0b97e046631509aac': '1', 'io_workload': '1', 'num_proj_12dc09d5d69246b19f02313d2f4596e0': '1', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_2beee2d64aaf4c20b3d265917ef6d0cb': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:27:33.106604 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:27:33.107942 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:27:33.108231 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Creating image(s)
May 13 04:27:33.108961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:33.109200 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:33.109844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:33.110562 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:27:33.115222 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:27:33.118395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:33.197265 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:33.197544 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:33.225853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.107s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:33.226362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:33.226850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:33.227373 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:27:33.230930 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:27:33.231334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:33.324421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:33.324959 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:33.342498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-bdcdadd6-922a-499e-bd6d-052f0ef6aa30 req-6165158f-c1c8-4f39-8392-53d367000871 service nova] Releasing lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:33.343509 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquired lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:33.343797 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:27:33.392552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk 1073741824" returned: 0 in 0.067s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:33.392967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:33.393280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:33.493858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.100s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:33.494473 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:27:33.494769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:33.606635 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:33.606993 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Cannot resize image /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:27:33.607397 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:27:33.607551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:27:33.607842 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:33.608189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:33.608350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:33.701648 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:33.920501 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:27:34.116208 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:34.208798 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:27:34.209349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.318s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:34.209889 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:34.256637 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating instance_info_cache with network_info: [{"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:34.333364 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:34.333839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:34.759145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Releasing lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:34.759534 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance network_info: |[{"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:27:34.761974 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Start _get_guest_xml network_info=[{"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:27:34.765962 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:27:34.767345 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1251728816', uuid='09d4ce84-6dd5-45cb-9b5b-42afca985ca6'), owner=OwnerMeta(userid='e4afc202e8f442f880bee837107aa232', username='tempest-VolumesSnapshotTestJSON-85989347-project-member', projectid='2beee2d64aaf4c20b3d265917ef6d0cb', projectname='tempest-VolumesSnapshotTestJSON-85989347'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646454.7669437) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:27:34.768483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:27:34.768830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:27:34.770080 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:27:34.770277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:27:34.771154 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:27:34.771530 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:27:34.771697 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:27:34.771813 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:27:34.771966 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:27:34.772091 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:27:34.772225 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:27:34.772438 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:27:34.772572 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:27:34.772716 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:27:34.772854 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:27:34.773014 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:27:34.783294 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1251728816',display_name='tempest-VolumesSnapshotTestJSON-instance-1251728816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1251728816',id=68,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL5TCYUUuX1e/aZcFKnYEMNhyOdb2SiuJi87Jvgqz/QuY/MUt+BKD0OhrEFLdbLcctxdJkvOuliKg4iQ5jPxL3HCNsgT3VINtK6WiG/sNExf8wPK/wFFhlTEA/NDsSR5Q==',key_name='tempest-keypair-1270976475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-mimq9zvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=09d4ce84-6dd5-45cb-9b5b-42afca985ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:27:34.783481 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:34.784082 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:34.784610 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'pci_devices' on Instance uuid 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:34.837454 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'flavor' on Instance uuid 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:35.264451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.287176 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] End _get_guest_xml xml=<domain type="qemu">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <uuid>09d4ce84-6dd5-45cb-9b5b-42afca985ca6</uuid>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <name>instance-00000044</name>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1251728816</nova:name>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:27:34</nova:creationTime>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:user uuid="e4afc202e8f442f880bee837107aa232">tempest-VolumesSnapshotTestJSON-85989347-project-member</nova:user>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:project uuid="2beee2d64aaf4c20b3d265917ef6d0cb">tempest-VolumesSnapshotTestJSON-85989347</nova:project>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         <nova:port uuid="dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <system>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="serial">09d4ce84-6dd5-45cb-9b5b-42afca985ca6</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="uuid">09d4ce84-6dd5-45cb-9b5b-42afca985ca6</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </system>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <os>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </os>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <features>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </features>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   <devices>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.config"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </disk>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:80:bd:e0"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <target dev="tapdac75c31-86"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </interface>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/console.log" append="off"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </serial>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <video>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </video>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </rng>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:   </devices>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]: </domain>
May 13 04:27:35.287176 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Preparing to wait for external event network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1251728816',display_name='tempest-VolumesSnapshotTestJSON-instance-1251728816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1251728816',id=68,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL5TCYUUuX1e/aZcFKnYEMNhyOdb2SiuJi87Jvgqz/QuY/MUt+BKD0OhrEFLdbLcctxdJkvOuliKg4iQ5jPxL3HCNsgT3VINtK6WiG/sNExf8wPK/wFFhlTEA/NDsSR5Q==',key_name='tempest-keypair-1270976475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-mimq9zvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=09d4ce84-6dd5-45cb-9b5b-42afca985ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:35.289188 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:27:35.289768 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.290112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:35.290423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:27:35.291703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.291884 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb0e819f-47cd-5be5-be21-34c0c89e76bb', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:35.293562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.293562 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:35.294114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.295945 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.296219 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdac75c31-86, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:35.296595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdac75c31-86, col_values=(('qos', UUID('c4800094-ec1c-4bcd-88a2-92876ac4a561')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:35.296786 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdac75c31-86, col_values=(('external_ids', {'iface-id': 'dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:bd:e0', 'vm-uuid': '09d4ce84-6dd5-45cb-9b5b-42afca985ca6'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:35.297753 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.299239 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:35.305694 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:35.306417 np0000000669 nova-compute[97951]: INFO os_vif [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86')
May 13 04:27:35.842857 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:36.824400 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:36.824400 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:36.824400 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No VIF found with MAC fa:16:3e:80:bd:e0, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:27:36.824400 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Using config drive
May 13 04:27:36.911263 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:36.911757 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:36.911757 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Attaching volume 8f4b954f-8f7e-435d-b656-ba78449d0993 to /dev/vdb
May 13 04:27:36.958452 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:36.974237 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:27:36.996630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:37.057508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:27:37.057508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:27:37.069820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:27:37.071069 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe0c:3b48', 'fe80::b4da:96ff:fe34:f9b4', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe06:82e4', 'fe80::7478:88ff:fe67:9708'] 
May 13 04:27:37.071239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:27:37.071336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:27:37.071578 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:37.071841 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating existing volume attachment record: 46775392-d5aa-4f5f-ad67-c35ca6153306 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:27:37.329282 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:37.436799 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Creating config drive at /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.config
May 13 04:27:37.440462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo7eym_tg {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:27:37.494861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo7eym_tg" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:27:37.655210 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7e31fa23-4a02-45c3-a5f7-ea015178b2e4', 'attached_at': '', 'detached_at': '', 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'serial': '8f4b954f-8f7e-435d-b656-ba78449d0993'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:27:37.656952 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:27:37.657284 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:37.657454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:37.657850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:37.658067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:27:37.669701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:37.670334 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:37.670745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:37.670895 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:37.671343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:37.671572 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:37.686526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:37.686526 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:37.696457 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:27:37.696457 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:37.701545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993] added
May 13 04:27:37.701545 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:37.701545 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:37.701545 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:37.701545 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:37.701545 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:37.701545 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:37.701780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:37.702038 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:37.702038 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:37.707101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993] added
May 13 04:27:37.707101 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:27:37.707101 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:37.707101 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:37.707101 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:27:37.707101 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:27:37.707101 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:37.707383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:27:37.707383 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:27:37.707506 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:27:37.885485 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:37.910188 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.001769 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.073609 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-07768185-21c6-4155-b4bc-93c23f3b7e59 req-a3189f16-42da-4e33-a6f3-6678f25915f9 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:38.073885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-07768185-21c6-4155-b4bc-93c23f3b7e59 req-a3189f16-42da-4e33-a6f3-6678f25915f9 service nova] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:38.074093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-07768185-21c6-4155-b4bc-93c23f3b7e59 req-a3189f16-42da-4e33-a6f3-6678f25915f9 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:38.074284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-07768185-21c6-4155-b4bc-93c23f3b7e59 req-a3189f16-42da-4e33-a6f3-6678f25915f9 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:38.074486 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-07768185-21c6-4155-b4bc-93c23f3b7e59 req-a3189f16-42da-4e33-a6f3-6678f25915f9 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Processing event network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:27:38.195083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.198304 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.200828 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.208850 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:38.209065 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:38.209176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:27:38.209422 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:38.222913 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.225378 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:38.619576 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646458.6191978, 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:38.619912 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:27:38.620056 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] VM Started (Lifecycle Event)
May 13 04:27:38.623192 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:27:38.625735 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance spawned successfully.
May 13 04:27:38.626048 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:27:38.702446 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:27:38.708453 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:38.716771 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:38.716771 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:27:38.726629 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:27:38.726629 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.731517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.740889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.747229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.747229 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.747229 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.747229 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.747229 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:38.748192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.748192 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.748192 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.748192 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.748192 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.758020 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:38.790927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.40.100,3260]
May 13 04:27:38.790927 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.40.100,3260] successful.
May 13 04:27:38.790927 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.797228 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.50.100,3260]
May 13 04:27:38.797228 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.50.100,3260] successful.
May 13 04:27:38.797228 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.803858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.809800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.820484 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.820932 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:38.821141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:38.821141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:38.821822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('7', '-', '-', 0) found on session 174 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:38.821950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.828066 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:38.830521 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('12', '-', '-', 0) found on session 175 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:27:38.830521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:27:38.842199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 174 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:38.842199 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:38.848210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 175 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:27:38.848848 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:27:39.079253 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:27:39.079718 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:39.122723 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:39.124909 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:39.134263 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.134420 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.134728 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.135184 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.135346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.135542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:27:39.627080 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:27:39.627225 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646459.6270635, 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:39.627283 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] VM Paused (Lifecycle Event)
May 13 04:27:39.641239 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Took 6.53 seconds to spawn the instance on the hypervisor.
May 13 04:27:39.641395 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:39.671193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:27:40.098719 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:27:40.129240 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:40.131207 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646460.1309764, 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:27:40.131316 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] VM Resumed (Lifecycle Event)
May 13 04:27:40.134691 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:40.134691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:40.134691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:40.134691 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:40.135500 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] No waiting events found dispatching network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:40.135691 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-16d1577e-e7a3-49e8-a99a-50ed0d4d11bb req-34136f47-eb94-4ba6-a66f-47aca5f4a430 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received unexpected event network-vif-plugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a for instance with vm_state active and task_state None.
May 13 04:27:40.152265 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Took 11.85 seconds to build instance.
May 13 04:27:40.272895 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:40.298165 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:40.635944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:27:40.638112 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:27:40.653726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8d72a0f3-f046-4348-b3b1-252a5c1ebf7e tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.354s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:40.685306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Found WWN 3300000004cd08536 for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:27:40.685548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:40.686408 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '3300000004cd08536', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000004cd08536'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:40.686543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004cd08536', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000004cd08536'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:27:40.688363 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:27:40.688553 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:27:40.688692 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:27:40.702873 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:27:40.702873 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:27:40.702873 np0000000669 nova-compute[97951]:     <volume>8f4b954f-8f7e-435d-b656-ba78449d0993</volume>
May 13 04:27:40.702873 np0000000669 nova-compute[97951]:   </usage>
May 13 04:27:40.702873 np0000000669 nova-compute[97951]: </secret>
May 13 04:27:40.702873 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:27:40.711142 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'flavor' on Instance uuid 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:41.217031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Attempting to attach volume 8f4b954f-8f7e-435d-b656-ba78449d0993 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:27:41.218712 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <alias name="ua-8f4b954f-8f7e-435d-b656-ba78449d0993"/>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <serial>8f4b954f-8f7e-435d-b656-ba78449d0993</serial>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="d77ee84d-8c98-4351-bac6-0741c45b89f0"/>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]: </disk>
May 13 04:27:41.218712 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:27:41.435919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-changed-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:41.436068 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Refreshing instance network info cache due to event network-changed-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:27:41.436293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] Acquiring lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:27:41.436426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] Acquired lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:27:41.436733 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Refreshing network info cache for port dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:27:41.939019 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:42.249651 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:42.390261 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updated VIF entry in instance network info cache for port dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:27:42.390514 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating instance_info_cache with network_info: [{"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:42.892220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cfb20518-87b0-4e52-bbc2-d72eaee22dcb req-ae201017-9c8f-4766-a7ff-f63bef02b2a3 service nova] Releasing lock "refresh_cache-09d4ce84-6dd5-45cb-9b5b-42afca985ca6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:27:43.793822 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:43.794411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:43.794411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:27:43.794411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No VIF found with MAC fa:16:3e:0c:3b:48, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:27:45.287598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:45.299838 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:45.343025 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3cabbadb-a95a-44a8-9e82-d3322739ca13 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.431s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:45.819067 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:45.819260 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:46.321509 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Detaching volume 8f4b954f-8f7e-435d-b656-ba78449d0993
May 13 04:27:46.365228 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Attempting to driver detach volume 8f4b954f-8f7e-435d-b656-ba78449d0993 from mountpoint /dev/vdb
May 13 04:27:46.407005 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '7e31fa23-4a02-45c3-a5f7-ea015178b2e4', 'attached_at': '', 'detached_at': '', 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'serial': '8f4b954f-8f7e-435d-b656-ba78449d0993'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:27:46.412892 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Found disk vdb by alias ua-8f4b954f-8f7e-435d-b656-ba78449d0993 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:27:46.414207 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Found disk vdb by alias ua-8f4b954f-8f7e-435d-b656-ba78449d0993 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:27:46.414316 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Attempting to detach device vdb from instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:27:46.414564 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <alias name="ua-8f4b954f-8f7e-435d-b656-ba78449d0993"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <serial>8f4b954f-8f7e-435d-b656-ba78449d0993</serial>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="d77ee84d-8c98-4351-bac6-0741c45b89f0"/>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]: </disk>
May 13 04:27:46.414564 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:27:46.421939 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully detached device vdb from instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 from the persistent domain config.
May 13 04:27:46.422226 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] (1/8): Attempting to detach device vdb with device alias ua-8f4b954f-8f7e-435d-b656-ba78449d0993 from instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:27:46.422545 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <alias name="ua-8f4b954f-8f7e-435d-b656-ba78449d0993"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <serial>8f4b954f-8f7e-435d-b656-ba78449d0993</serial>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="d77ee84d-8c98-4351-bac6-0741c45b89f0"/>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]: </disk>
May 13 04:27:46.422545 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:27:46.931441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646466.9310882, 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 => ua-8f4b954f-8f7e-435d-b656-ba78449d0993> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:27:46.932893 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8f4b954f-8f7e-435d-b656-ba78449d0993 for instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:27:46.935402 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully detached device vdb from instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 from the live domain config.
May 13 04:27:46.938023 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:27:46.938277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:27:46.938511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:27:46.938855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:27:46.939127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f4b954f-8f7e-435d-b656-ba78449d0993', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:27:46.939249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:46.968223 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993 (non-flash)
May 13 04:27:46.968697 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '175')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:27:46.968697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '174')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:27:46.969469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993', '175')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:27:46.970247 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12c040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:27:46.970450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Removing multipathed devices sdb, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:27:46.970692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flush multipath device 3300000004cd08536 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:27:47.015450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:27:47.057974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:27:47.100975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if SCSI volumes sdb, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:27:47.101143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] SCSI volumes sdb, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:27:47.102015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if device paths {'sdb', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:27:47.113384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Device paths {'sdb', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:27:47.113510 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:27:47.125696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.154532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.40.100,3260]
May 13 04:27:47.154532 np0000000669 nova-compute[97951]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.40.100,3260] successful.
May 13 04:27:47.154532 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.168637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.182140 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.210159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.50.100,3260]
May 13 04:27:47.210159 np0000000669 nova-compute[97951]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-8f4b954f-8f7e-435d-b656-ba78449d0993, portal: 192.168.50.100,3260] successful.
May 13 04:27:47.210159 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.224026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:27:47.224958 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:27:47.225076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== disconnect_volume: return (286ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:27:47.225181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:27:47.770941 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'flavor' on Instance uuid 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:48.777345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1827f84d-5fb2-4a1d-8e69-4f77f1dadcd5 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:49.129129 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:49.129448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:49.129657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:49.129780 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:49.129967 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:49.132453 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Terminating instance
May 13 04:27:49.636120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:27:49.651851 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.654055 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.669732 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.679072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.697362 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.700910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] No waiting events found dispatching network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:49.801946 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5ddf04cd-56b1-4fb8-a93d-590dea585470 req-1e376cf4-7316-4186-851a-7a4249e8ea35 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:27:49.951034 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999742277999758 future=<Future at 0x7a463c404bf0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:49.951778 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99942301200008 future=<Future at 0x7a463c404bf0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:49.951778 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999237450999772 future=<Future at 0x7a463c404bf0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:49.953086 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Instance destroyed successfully.
May 13 04:27:49.953526 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'resources' on Instance uuid 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:27:50.290168 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.300457 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.455690 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1581098954',display_name='tempest-TestEncryptedCinderVolumes-server-1581098954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1581098954',id=65,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBnGY+2JGj3TjAcABhZflcjHEwrFmHh7TUc4ed0G67mb1cByaaFhHdItMV5523rf9Gb9byXxTxCkRwKRqh28pe8hur1hO7ZTUl7NDILJSULiPO5RqS7ibQvukcX1kxLpg==',key_name='tempest-keypair-675825021',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:26:56Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-lmzc9mgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=7e31fa23-4a02-45c3-a5f7-ea015178b2e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:27:50.455961 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "7de34297-24ef-401e-b9ab-79d32947bb08", "address": "fa:16:3e:0c:3b:48", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34297-24", "ovs_interfaceid": "7de34297-24ef-401e-b9ab-79d32947bb08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:27:50.456465 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:27:50.456782 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:27:50.458020 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.458186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7de34297-24, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:50.459093 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.459804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:50.460136 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.460736 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:50.460849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=873386bf-7bd7-4e40-be34-f39caa82809b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:27:50.462848 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:27:50.464283 np0000000669 nova-compute[97951]: INFO os_vif [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3b:48,bridge_name='br-int',has_traffic_filtering=True,id=7de34297-24ef-401e-b9ab-79d32947bb08,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34297-24')
May 13 04:27:50.464649 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Deleting instance files /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4_del
May 13 04:27:50.465289 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Deletion of /opt/stack/data/nova/instances/7e31fa23-4a02-45c3-a5f7-ea015178b2e4_del complete
May 13 04:27:50.971575 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Took 1.34 seconds to destroy the instance on the hypervisor.
May 13 04:27:50.972150 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:27:50.972239 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:27:50.972317 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:27:50.972532 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:51.059764 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:27:51.465958 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-57f2934f-834b-4550-b018-c0497276d46a req-bdcf22f8-44a7-4f40-8116-3c88308a7f3e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-deleted-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:51.467688 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-57f2934f-834b-4550-b018-c0497276d46a req-bdcf22f8-44a7-4f40-8116-3c88308a7f3e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Neutron deleted interface 7de34297-24ef-401e-b9ab-79d32947bb08; detaching it from the instance and deleting it from the info cache
May 13 04:27:51.467838 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-57f2934f-834b-4550-b018-c0497276d46a req-bdcf22f8-44a7-4f40-8116-3c88308a7f3e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:51.867049 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:51.867186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] Acquiring lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:51.867800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:51.867800 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:51.867800 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] No waiting events found dispatching network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:51.867800 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-31f3fcda-0dac-4876-a08b-11c339b22391 req-a71d80cf-570a-4ad6-b8f5-eafbb47118c8 service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Received event network-vif-unplugged-7de34297-24ef-401e-b9ab-79d32947bb08 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:27:51.917827 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:27:51.972112 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-57f2934f-834b-4550-b018-c0497276d46a req-bdcf22f8-44a7-4f40-8116-3c88308a7f3e service nova] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Detach interface failed, port_id=7de34297-24ef-401e-b9ab-79d32947bb08, reason: Instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:27:52.419824 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Took 1.45 seconds to deallocate network for instance.
May 13 04:27:52.927179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:52.927368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:53.181797 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:27:53.182289 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:27:53.685345 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:27:54.193275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.266s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:54.241591 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deleted allocations for instance 7e31fa23-4a02-45c3-a5f7-ea015178b2e4
May 13 04:27:55.250909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bdd70aeb-88b3-4d6d-ab4f-eca2d4eb78b4 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "7e31fa23-4a02-45c3-a5f7-ea015178b2e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.121s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:55.305535 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:55.462032 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.040902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:59.041220 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:59.041408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:59.041593 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:59.041752 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:59.043967 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Terminating instance
May 13 04:27:59.547599 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:27:59.569397 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.571443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.589203 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.593412 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.613137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.617798 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:27:59.756351 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:27:59.756351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:27:59.756351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:27:59.756651 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:27:59.756651 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] No waiting events found dispatching network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:27:59.756651 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8f684457-01c8-4033-8182-bca492564a46 req-462cf636-c478-400b-ba18-65ded3b19081 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:27:59.865173 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999706561000039 future=<Future at 0x7a463c154710 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:27:59.868591 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Instance destroyed successfully.
May 13 04:27:59.868715 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 235d868f-e4d2-4af5-a96f-9e5bc7b3332e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:00.306074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:00.373174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-91752006',display_name='tempest-TestVolumeBootPattern-server-91752006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-91752006',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:27:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-7qg693uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:27:25Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=235d868f-e4d2-4af5-a96f-9e5bc7b3332e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:28:00.373456 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "f167aecf-f9fa-400f-a359-6551bb70c525", "address": "fa:16:3e:06:82:e4", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf167aecf-f9", "ovs_interfaceid": "f167aecf-f9fa-400f-a359-6551bb70c525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:00.373966 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:00.374204 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:28:00.375337 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:00.375536 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf167aecf-f9, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:00.376560 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:00.377787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:00.378114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:00.378114 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f910a8e4-7072-43d6-98ff-254888d4eca4) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:00.378885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:00.379374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:00.381306 np0000000669 nova-compute[97951]: INFO os_vif [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:82:e4,bridge_name='br-int',has_traffic_filtering=True,id=f167aecf-f9fa-400f-a359-6551bb70c525,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf167aecf-f9')
May 13 04:28:00.382717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:28:00.383017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:00.383164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:00.383546 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:00.383853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:28:00.384007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:28:00.408612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:00.408612 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:00.408612 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:00.408612 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:00.408612 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:00.408935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:00.408935 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:00.408935 np0000000669 nova-compute[97951]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:00.408935 np0000000669 nova-compute[97951]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:00.408935 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:00.408935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '173')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:28:00.409187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '172')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:00.410229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '173')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:00.411121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480f72e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:28:00.411376 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdf, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:28:00.411639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 330000000c37cdf2a {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:28:00.473018 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:28:00.522845 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:28:00.575661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:28:00.575793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:28:00.576508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:28:00.587342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:28:00.587567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:28:00.600668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.633428 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260]
May 13 04:28:00.633428 np0000000669 nova-compute[97951]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260] successful.
May 13 04:28:00.633428 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.647707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.658597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.683316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260]
May 13 04:28:00.683316 np0000000669 nova-compute[97951]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260] successful.
May 13 04:28:00.683316 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.697775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:00.697775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:00.697775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (313ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:00.697775 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:28:00.697775 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Deleting instance files /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e_del
May 13 04:28:00.698111 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Deletion of /opt/stack/data/nova/instances/235d868f-e4d2-4af5-a96f-9e5bc7b3332e_del complete
May 13 04:28:01.204066 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Took 1.66 seconds to destroy the instance on the hypervisor.
May 13 04:28:01.204623 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:28:01.204944 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:28:01.205028 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:28:01.205234 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:01.265981 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:01.839066 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:01.839404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] Acquiring lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:01.839404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:01.839520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:01.839647 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] No waiting events found dispatching network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:01.840194 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-unplugged-f167aecf-f9fa-400f-a359-6551bb70c525 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:28:01.840372 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Received event network-vif-deleted-f167aecf-f9fa-400f-a359-6551bb70c525 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:01.840530 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Neutron deleted interface f167aecf-f9fa-400f-a359-6551bb70c525; detaching it from the instance and deleting it from the info cache
May 13 04:28:01.840677 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:02.160519 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:02.346355 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4923707d-145f-431b-b4df-744ed79f9697 req-1e31c798-f272-4c5a-98ae-7bc37dfea135 service nova] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Detach interface failed, port_id=f167aecf-f9fa-400f-a359-6551bb70c525, reason: Instance 235d868f-e4d2-4af5-a96f-9e5bc7b3332e could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:28:02.663500 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Took 1.46 seconds to deallocate network for instance.
May 13 04:28:03.210446 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:28:03.715136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:03.715293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:03.899096 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:03.899431 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:04.402644 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:04.910510 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.195s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:04.951107 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003800620002039068 future=<Future at 0x7a463c404bf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:04.951288 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:04.951288 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.912883119000071 future=<Future at 0x7a463c154710 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:04.951387 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=9.912787634000324 future=<Future at 0x7a463c154710 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:04.952107 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Emitting event <LifecycleEvent: 1778646469.9506223, 7e31fa23-4a02-45c3-a5f7-ea015178b2e4 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:04.952356 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] VM Stopped (Lifecycle Event)
May 13 04:28:04.974433 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 235d868f-e4d2-4af5-a96f-9e5bc7b3332e
May 13 04:28:05.308083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:05.379487 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:05.461061 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: 7e31fa23-4a02-45c3-a5f7-ea015178b2e4] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:05.724927 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:05.725105 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:05.982864 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-73754775-6c23-496f-a8df-75ba315f2ad3 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "235d868f-e4d2-4af5-a96f-9e5bc7b3332e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.942s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:06.226857 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:28:06.783304 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:06.783728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:06.786898 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:28:06.787057 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Claim successful on node np0000000669
May 13 04:28:07.962730 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:07.963211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:08.014987 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:08.015230 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:08.471950 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:28:08.518137 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:09.015488 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:09.027113 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.243s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:09.027669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:09.027853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:28:09.032825 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:28:09.032946 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Claim successful on node np0000000669
May 13 04:28:09.539092 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:28:09.539290 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:28:09.539620 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:09.539812 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:09.621975 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9431469bdf974894a3493b27bb04be38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc09d5d69246b19f02313d2f4596e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:28:10.047223 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:28:10.049558 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Successfully created port: 4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:28:10.269513 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:10.269791 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:10.309474 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:10.383767 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:10.482158 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Successfully updated port: 4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:28:10.527438 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-changed-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:10.527574 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Refreshing instance network info cache due to event network-changed-4407a5c3-0f6e-4fdd-9519-586f16960f47. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:10.527740 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] Acquiring lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:10.527827 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] Acquired lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:10.527952 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Refreshing network info cache for port 4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:10.554176 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:28:10.773915 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:10.985021 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:11.029802 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:11.058382 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Booting with volume f49571f9-c72f-4b3f-a98d-c205639d4726 at /dev/vda
May 13 04:28:11.090778 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:11.092876 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:11.102461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:28:11.122553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:11.172092 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:28:11.173143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:28:11.180463 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:28:11.181709 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe80:bde0', 'fe80::4474:a5ff:fe48:e7d9'] 
May 13 04:28:11.181821 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:28:11.181925 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:28:11.182158 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:11.182411 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating existing volume attachment record: 4737c8f4-b8f7-4798-aeb5-8e859ee50b21 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:28:11.228277 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:11.280461 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.253s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:11.280461 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:28:11.730541 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e795e1fa-1713-4ada-8f54-c0dd02f8b787 req-25f4d306-99f3-402d-b4c7-a7a870f8a440 service nova] Releasing lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:11.732135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquired lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:11.732347 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:28:11.787502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:28:11.787991 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:28:11.788391 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:11.788628 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:11.858553 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:28:12.291884 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:28:12.312867 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Successfully created port: 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:28:12.325304 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:12.501788 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:12.633315 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating instance_info_cache with network_info: [{"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:12.784713 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Successfully updated port: 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:28:12.794582 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:28:12.839729 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:12.840424 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing instance network info cache due to event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:12.840563 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] Acquiring lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:12.840609 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] Acquired lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:12.840769 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing network info cache for port 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:13.137371 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Releasing lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:13.137624 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance network_info: |[{"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:28:13.284092 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:28:13.285069 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:28:13.285337 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Creating image(s)
May 13 04:28:13.285729 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:28:13.285889 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Ensure instance console log exists: /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:28:13.286201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:13.286395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:13.286556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:13.287072 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Start _get_guest_xml network_info=[{"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0007dd3e-b366-4789-84a8-6b7983f4375e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'serial': 'f49571f9-c72f-4b3f-a98d-c205639d4726'}, 'disk_bus': 'virtio', 'attachment_id': '4737c8f4-b8f7-4798-aeb5-8e859ee50b21', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:28:13.287756 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:13.291259 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:28:13.292402 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-459721723', uuid='0007dd3e-b366-4789-84a8-6b7983f4375e'), owner=OwnerMeta(userid='9431469bdf974894a3493b27bb04be38', username='tempest-TestVolumeBootPatternV346-1311400665-project-member', projectid='12dc09d5d69246b19f02313d2f4596e0', projectname='tempest-TestVolumeBootPatternV346-1311400665'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646493.292029) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:28:13.293771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:28:13.294076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:28:13.295132 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:28:13.295281 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:28:13.296298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:28:13.296583 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:28:13.296736 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:28:13.296829 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:28:13.296946 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:28:13.297046 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:28:13.297141 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:28:13.297341 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:28:13.297458 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:28:13.297578 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:28:13.297708 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:28:13.297828 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:28:13.304989 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Booting with volume ec2f50fb-f606-4902-a641-0c9a595d76f5 at /dev/vda
May 13 04:28:13.310547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:28:13.310896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:13.311089 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:13.311439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:13.311635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:28:13.323223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:13.323897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:13.324354 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:13.324586 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:13.325035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:13.325203 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:13.336441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:13.336441 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:13.341700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:13.341700 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:13.343277 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:13.344086 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:13.352556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726] added
May 13 04:28:13.352556 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:13.352556 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:13.352556 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:13.352556 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:13.352556 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:13.352556 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:13.352889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:13.353146 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:13.353146 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726] added
May 13 04:28:13.357461 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:13.357461 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:13.357461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:13.357819 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:13.357819 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:13.359149 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:28:13.379813 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:13.409649 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:13.428926 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:28:13.429341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:28:13.439877 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:28:13.441028 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe80:bde0', 'fe80::4474:a5ff:fe48:e7d9'] 
May 13 04:28:13.441159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:28:13.441282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:28:13.441522 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:13.441725 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating existing volume attachment record: 322a76eb-bbe0-46e8-975e-9a4219bff514 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:28:13.549863 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:14.052179 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d1a9dc84-cb65-4d6f-83dd-716496aae1fa req-2cae6785-1afd-42b9-bc30-2a6f355f35ba service nova] Releasing lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:14.052850 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:14.053041 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:28:14.353899 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:14.358497 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:14.367300 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:14.367300 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:14.375195 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:14.375195 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.383606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.390956 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.398169 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.398169 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.398169 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:14.398375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.398375 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.398375 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:14.405025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.405025 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.405025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:14.405025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.405025 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.405025 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:14.432468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.50.100,3260]
May 13 04:28:14.432468 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.50.100,3260] successful.
May 13 04:28:14.432468 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.433347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.40.100,3260]
May 13 04:28:14.433347 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.40.100,3260] successful.
May 13 04:28:14.433347 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.446218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.452376 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:14.461279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.461279 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.461279 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.461279 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.461279 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:14.461468 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.461468 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.461468 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.461468 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.461468 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:14.461789 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:14.462009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:14.463076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('7', '-', '-', 0) found on session 178 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:14.463210 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:14.470791 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:14.470791 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('10', '-', '-', 0) found on session 179 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:14.471285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:14.481646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 178 and hctl ['7', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:14.491099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 179 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:14.491099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:14.640372 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:14.824739 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:14.864722 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00048455499972988036 future=<Future at 0x7a463c154710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:14.864889 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:14.865552 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] Emitting event <LifecycleEvent: 1778646479.8641212, 235d868f-e4d2-4af5-a96f-9e5bc7b3332e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:14.865738 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] VM Stopped (Lifecycle Event)
May 13 04:28:14.964800 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:15.256284 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:15.257353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:15.369369 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-f15227d4-5f86-46ba-ab4c-2a46552f9cf6 tempest-VolumesActionsTest-863508426 tempest-VolumesActionsTest-863508426-project-member] [instance: 235d868f-e4d2-4af5-a96f-9e5bc7b3332e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:15.385362 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:15.466789 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:15.467000 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance network_info: |[{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:28:15.482341 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 178 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:15.482508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:15.558788 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:28:15.560145 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:28:15.560529 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Creating image(s)
May 13 04:28:15.560888 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:28:15.561131 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Ensure instance console log exists: /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:28:15.561444 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:15.561662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:15.561860 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:15.562483 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Start _get_guest_xml network_info=[{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'eb39b253-78ff-4768-aec4-cde1a39f1217', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'serial': 'ec2f50fb-f606-4902-a641-0c9a595d76f5'}, 'disk_bus': 'virtio', 'attachment_id': '322a76eb-bbe0-46e8-975e-9a4219bff514', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:28:15.565178 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:28:15.566526 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1487281873', uuid='eb39b253-78ff-4768-aec4-cde1a39f1217'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646495.5661287) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:28:15.567813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:28:15.568254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:28:15.569336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:28:15.569563 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:28:15.570709 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:28:15.571111 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:28:15.571313 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:28:15.571494 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:28:15.571696 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:28:15.571844 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:28:15.572047 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:28:15.572220 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:28:15.572402 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:28:15.572558 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:28:15.572739 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:28:15.572934 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:28:15.588747 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:28:15.589094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:15.589266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:15.758811 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:28:16.304122 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:16.304353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:16.307706 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:28:16.307897 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Claim successful on node np0000000669
May 13 04:28:16.339929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Found WWN 330000000eb16df3a for multipath device dm-3 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:28:16.340465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:16.340618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000eb16df3a', 'path': '/dev/dm-3', 'multipath_id': '330000000eb16df3a'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:16.340744 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb16df3a', 'path': '/dev/dm-3', 'multipath_id': '330000000eb16df3a'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:28:16.341120 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.752s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:16.341352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:28:16.352713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:16.353494 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:16.354433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:16.354726 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:16.355648 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:16.355827 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:16.365898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:16.365898 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:16.370416 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:16.370416 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:16.376799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5] added
May 13 04:28:16.376799 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:16.376799 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:16.376799 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:16.376799 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:16.376799 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:16.376799 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:16.376981 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:16.377736 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:16.377960 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:16.380398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5] added
May 13 04:28:16.380398 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:16.380398 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:16.380398 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:16.380398 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:16.380398 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:16.380398 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:16.380556 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:16.380672 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:16.380787 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:16.845863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-459721723',display_name='tempest-TestVolumeBootPatternV346-server-459721723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-459721723',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMw4l1YCBeN2oY/HKx8oqZwOV4CsBrAVNbqmuQoJiQUOypM7lZzb4Wbx2orJhSpA1tmnDZXzoZqMwhyPtdvkL4DDDRCh6Yn3k6WzWWtvaYF2edAI5L3+bcRq0Y6w3vt1Q==',key_name='tempest-keypair-1172956807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-0d18jfwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=0007dd3e-b366-4789-84a8-6b7983f4375e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:28:16.846076 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:16.846626 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:16.847506 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'pci_devices' on Instance uuid 0007dd3e-b366-4789-84a8-6b7983f4375e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:17.350341 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] End _get_guest_xml xml=<domain type="qemu">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <uuid>0007dd3e-b366-4789-84a8-6b7983f4375e</uuid>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <name>instance-00000045</name>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPatternV346-server-459721723</nova:name>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:28:13</nova:creationTime>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:user uuid="9431469bdf974894a3493b27bb04be38">tempest-TestVolumeBootPatternV346-1311400665-project-member</nova:user>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:project uuid="12dc09d5d69246b19f02313d2f4596e0">tempest-TestVolumeBootPatternV346-1311400665</nova:project>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         <nova:port uuid="4407a5c3-0f6e-4fdd-9519-586f16960f47">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <system>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="serial">0007dd3e-b366-4789-84a8-6b7983f4375e</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="uuid">0007dd3e-b366-4789-84a8-6b7983f4375e</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </system>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <os>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </os>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <features>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </features>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   <devices>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/disk.config"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <alias name="ua-f49571f9-c72f-4b3f-a98d-c205639d4726"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-3"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <serial>f49571f9-c72f-4b3f-a98d-c205639d4726</serial>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:41:92:aa"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <target dev="tap4407a5c3-0f"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </interface>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/console.log" append="off"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </serial>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <video>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </video>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </rng>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:   </devices>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]: </domain>
May 13 04:28:17.350341 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:28:17.352524 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Preparing to wait for external event network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:28:17.352524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:17.352524 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:17.352632 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:17.353245 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-459721723',display_name='tempest-TestVolumeBootPatternV346-server-459721723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-459721723',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMw4l1YCBeN2oY/HKx8oqZwOV4CsBrAVNbqmuQoJiQUOypM7lZzb4Wbx2orJhSpA1tmnDZXzoZqMwhyPtdvkL4DDDRCh6Yn3k6WzWWtvaYF2edAI5L3+bcRq0Y6w3vt1Q==',key_name='tempest-keypair-1172956807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-0d18jfwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=0007dd3e-b366-4789-84a8-6b7983f4375e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:28:17.353451 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:17.353917 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:17.354138 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:28:17.354478 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.355085 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:17.355240 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:28:17.356181 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.356348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '387929ea-2146-5ae5-889c-b9de9e9a8783', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:17.357162 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.358072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:17.358215 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.360174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.360552 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4407a5c3-0f, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:17.360680 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4407a5c3-0f, col_values=(('qos', UUID('d8d65a41-30c7-4f82-9df8-a75872533054')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:17.360748 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4407a5c3-0f, col_values=(('external_ids', {'iface-id': '4407a5c3-0f6e-4fdd-9519-586f16960f47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:92:aa', 'vm-uuid': '0007dd3e-b366-4789-84a8-6b7983f4375e'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:17.361470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.362993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:17.367117 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:17.367878 np0000000669 nova-compute[97951]: INFO os_vif [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f')
May 13 04:28:17.379108 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:17.382637 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:17.391692 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:17.391692 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:17.398438 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:17.398438 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.404380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.413471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.421633 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.421633 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.421633 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.421633 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.421633 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:17.421995 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.421995 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.421995 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.421995 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.421995 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:17.428516 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.428516 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.428516 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.428516 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.428516 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:17.428858 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.428858 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.428858 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.428858 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.428858 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:17.455907 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260]
May 13 04:28:17.455907 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260] successful.
May 13 04:28:17.455907 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.470371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.475605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260]
May 13 04:28:17.475605 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260] successful.
May 13 04:28:17.475605 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.484947 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.485194 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:17.485402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:17.485550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:17.486513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('11', '-', '-', 0) found on session 180 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:17.486656 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:17.487239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:17.501717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 180 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:17.501897 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.509515 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:17.509724 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:17.509952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:17.510127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:17.512768 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:17.512929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:17.516166 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('12', '-', '-', 0) found on session 181 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:17.516269 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:17.532682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 181 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:17.532843 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:17.617159 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:17.617159 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:18.017549 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:18.119841 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:18.357284 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:28:18.520084 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Ignoring supplied device name: /dev/vdb
May 13 04:28:18.625907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.321s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:18.626151 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:28:18.891806 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:18.891916 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:18.892006 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No VIF found with MAC fa:16:3e:41:92:aa, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:28:18.892341 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Using config drive
May 13 04:28:19.022396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:19.132185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:28:19.132895 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:28:19.132895 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:19.133152 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:19.203161 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb359d584a0b41398ca70e7e57fd589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7988aac1411045f0b97e046631509aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:28:19.372598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 330000000c37cdf2a for multipath device dm-6 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:28:19.372823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:19.373003 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3783ms) {'type': 'block', 'scsi_wwn': '330000000c37cdf2a', 'path': '/dev/dm-6', 'multipath_id': '330000000c37cdf2a'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:19.373059 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c37cdf2a', 'path': '/dev/dm-6', 'multipath_id': '330000000c37cdf2a'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:28:19.397021 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:19.501773 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Creating config drive at /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/disk.config
May 13 04:28:19.505749 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2d1ony_ {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:19.569580 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2d1ony_" returned: 0 in 0.064s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:19.600819 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Successfully created port: d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:28:19.635621 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:28:19.878218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1487281873',display_name='tempest-TestVolumeBootPattern-server-1487281873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1487281873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-a3nl79ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:13Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=eb39b253-78ff-4768-aec4-cde1a39f1217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:28:19.878447 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:19.879121 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:19.880048 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid eb39b253-78ff-4768-aec4-cde1a39f1217 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:19.974197 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:19.991788 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.020033 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Successfully updated port: d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:28:20.074222 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-changed-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:20.074222 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Refreshing instance network info cache due to event network-changed-d1622c70-b119-4e98-8b2d-0c6911e548c3. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:20.074345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] Acquiring lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:20.074458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] Acquired lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:20.075311 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Refreshing network info cache for port d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:20.085120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.085724 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.090112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.098775 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:20.098944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:20.099117 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Attaching volume c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 to /dev/vdb
May 13 04:28:20.138652 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:28:20.147107 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:20.151015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe2b474b-650f-48eb-80aa-c52c1e333da3 req-9925952f-a219-443c-b5f8-56909281e0a9 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:20.151492 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe2b474b-650f-48eb-80aa-c52c1e333da3 req-9925952f-a219-443c-b5f8-56909281e0a9 service nova] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:20.151701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe2b474b-650f-48eb-80aa-c52c1e333da3 req-9925952f-a219-443c-b5f8-56909281e0a9 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:20.151915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe2b474b-650f-48eb-80aa-c52c1e333da3 req-9925952f-a219-443c-b5f8-56909281e0a9 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:20.152037 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe2b474b-650f-48eb-80aa-c52c1e333da3 req-9925952f-a219-443c-b5f8-56909281e0a9 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Processing event network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:28:20.161703 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:28:20.188204 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:20.248090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:28:20.248659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:28:20.258876 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:28:20.260886 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe80:bde0', 'fe80::4474:a5ff:fe48:e7d9', 'fe80::fc16:3eff:fe41:92aa'] 
May 13 04:28:20.261007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:28:20.261095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:28:20.261638 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:20.261928 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating existing volume attachment record: 6ccc1703-29ea-4cd7-91c5-8d04a9a1749d {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:28:20.311950 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.383857 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] End _get_guest_xml xml=<domain type="qemu">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <uuid>eb39b253-78ff-4768-aec4-cde1a39f1217</uuid>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <name>instance-00000046</name>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-1487281873</nova:name>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:28:15</nova:creationTime>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         <nova:port uuid="6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <system>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="serial">eb39b253-78ff-4768-aec4-cde1a39f1217</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="uuid">eb39b253-78ff-4768-aec4-cde1a39f1217</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </system>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <os>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </os>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <features>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </features>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   <devices>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/disk.config"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <alias name="ua-ec2f50fb-f606-4902-a641-0c9a595d76f5"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-6"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <serial>ec2f50fb-f606-4902-a641-0c9a595d76f5</serial>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:dd:6b:81"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <target dev="tap6dbd5d16-c0"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </interface>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/console.log" append="off"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </serial>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <video>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </video>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </rng>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:   </devices>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]: </domain>
May 13 04:28:20.383857 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:28:20.385905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Preparing to wait for external event network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:28:20.385905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:20.385905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:20.385905 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:20.385905 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1487281873',display_name='tempest-TestVolumeBootPattern-server-1487281873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1487281873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-a3nl79ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:13Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=eb39b253-78ff-4768-aec4-cde1a39f1217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:28:20.386093 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:20.386639 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:20.386926 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:28:20.387229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.387451 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:20.387706 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:28:20.388403 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.388539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b335a527-2374-5393-a076-0992401a91cf', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:20.389244 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.389907 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:20.390125 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.392005 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.392130 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dbd5d16-c0, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:20.392427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dbd5d16-c0, col_values=(('qos', UUID('253c8e43-4353-4804-ae04-f4fb3d454ffd')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:20.393195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dbd5d16-c0, col_values=(('external_ids', {'iface-id': '6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:6b:81', 'vm-uuid': 'eb39b253-78ff-4768-aec4-cde1a39f1217'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:20.393899 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.395030 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:20.400984 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:20.401992 np0000000669 nova-compute[97951]: INFO os_vif [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0')
May 13 04:28:20.522634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:20.576635 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:20.650065 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Booting with volume 5f160363-518f-4ab6-a001-6debc0f3ccd7 at /dev/vda
May 13 04:28:20.653529 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:20.690062 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:20.700409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:28:20.720645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:20.768339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:28:20.768589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:28:20.777491 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:28:20.778512 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe80:bde0', 'fe80::4474:a5ff:fe48:e7d9', 'fe80::fc16:3eff:fe41:92aa'] 
May 13 04:28:20.778680 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:28:20.778827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:28:20.779100 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:20.779348 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating existing volume attachment record: 94441e0c-8c3a-4983-ad52-349f93f02aae {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:28:20.786084 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646500.785581, 0007dd3e-b366-4789-84a8-6b7983f4375e => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:20.786942 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:28:20.787583 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] VM Started (Lifecycle Event)
May 13 04:28:20.790171 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:28:20.794906 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance spawned successfully.
May 13 04:28:20.795513 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:28:20.813672 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:20.817763 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:28:20.818013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:20.818173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:20.818670 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:20.818940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:28:20.834405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:20.835316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:20.835953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:20.836219 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:20.836927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:20.837122 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:20.850455 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:20.850455 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:20.855993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:20.855993 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:20.861912 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2] added
May 13 04:28:20.861912 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:20.861912 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:20.861912 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:20.861912 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:20.861912 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:20.861912 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:20.862170 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:20.862256 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:20.862427 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:20.869091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2] added
May 13 04:28:20.869091 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:20.869091 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:20.869091 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:20.869091 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:20.869091 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:20.869091 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:20.869499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:20.869499 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:20.869682 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:21.293070 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:21.295927 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:21.304759 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.304883 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.305169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.305389 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.305805 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.305871 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:21.316909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d4b1ee41-63b9-4b01-9c79-907e65183666 req-5e62bd65-7dc5-4b61-b8e6-2ec19367a25d service nova] Releasing lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:21.319360 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquired lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:21.319568 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:28:21.800161 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:28:21.800599 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646501.8002667, 0007dd3e-b366-4789-84a8-6b7983f4375e => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:21.800599 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] VM Paused (Lifecycle Event)
May 13 04:28:21.812518 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Took 8.53 seconds to spawn the instance on the hypervisor.
May 13 04:28:21.812770 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:21.862820 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:21.871766 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:21.877622 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:21.877622 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:21.887188 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:21.887188 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.894605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.901016 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:21.903122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.912918 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.913349 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.919309 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.919673 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:21.921966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:21.922074 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:21.922165 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:dd:6b:81, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:28:21.922633 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Using config drive
May 13 04:28:21.953960 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.40.100,3260]
May 13 04:28:21.953960 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.40.100,3260] successful.
May 13 04:28:21.953960 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.968438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.969222 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.50.100,3260]
May 13 04:28:21.969222 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.50.100,3260] successful.
May 13 04:28:21.969222 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.983777 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:21.985235 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:21.985589 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:21.985918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:21.985918 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:21.986835 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] HCTL ('13', '-', '-', 0) found on session 182 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:21.986983 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:22.002604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:22.005673 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:22.005948 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:22.006160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:22.006315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:22.007375 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] HCTL ('14', '-', '-', 0) found on session 183 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:22.007514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:22.022696 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching for a device in session 183 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:22.022846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:22.090454 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:22.236690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:22.237932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:22.237932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:22.237932 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:22.237932 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] No waiting events found dispatching network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:22.237932 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-ee78e8d3-c58c-4d6b-b701-800257ea8af2 req-32877605-a37c-4964-84a4-205b919f6966 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received unexpected event network-vif-plugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 for instance with vm_state active and task_state None.
May 13 04:28:22.253931 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating instance_info_cache with network_info: [{"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:22.302758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:22.304726 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646502.3045278, 0007dd3e-b366-4789-84a8-6b7983f4375e => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:22.304860 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] VM Resumed (Lifecycle Event)
May 13 04:28:22.320166 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Took 15.59 seconds to build instance.
May 13 04:28:22.429147 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:22.561406 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Creating config drive at /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/disk.config
May 13 04:28:22.567351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5wbxyx2 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:22.616254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5wbxyx2" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:22.756275 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Releasing lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:22.756757 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance network_info: |[{"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:28:22.809301 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:22.811802 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:22.821601 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-55963748-0492-4eed-8a1e-f9aa81c9c070 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.096s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:22.891295 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:28:22.892559 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:28:22.892781 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Creating image(s)
May 13 04:28:22.893038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:28:22.893181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Ensure instance console log exists: /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:28:22.893536 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:22.893737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:22.893858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:22.894300 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Start _get_guest_xml network_info=[{"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e7a51a0e-6750-4d15-8071-3505dcfb2101', 'attached_at': '', 'detached_at': '', 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'serial': '5f160363-518f-4ab6-a001-6debc0f3ccd7'}, 'disk_bus': 'virtio', 'attachment_id': '94441e0c-8c3a-4983-ad52-349f93f02aae', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:28:22.898022 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:28:22.899020 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1097549913', uuid='e7a51a0e-6750-4d15-8071-3505dcfb2101'), owner=OwnerMeta(userid='cb359d584a0b41398ca70e7e57fd589f', username='tempest-TestEncryptedCinderVolumes-1387017513-project-member', projectid='7988aac1411045f0b97e046631509aac', projectname='tempest-TestEncryptedCinderVolumes-1387017513'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646502.8987086) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:28:22.900393 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:28:22.900696 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:28:22.902042 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:28:22.902251 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:28:22.903309 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:28:22.903888 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:28:22.903888 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:28:22.904041 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:28:22.904208 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:28:22.904350 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:28:22.904503 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:28:22.904721 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:28:22.904861 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:28:22.905007 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:28:22.905146 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:28:22.905298 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:28:22.920840 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:28:22.921336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:22.921590 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:22.987646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.003356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:23.003537 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:23.012042 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.106718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.177818 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-874903d1-fce3-45e6-9fb2-6a5482fe5993 req-0866e7bc-7027-46e1-9f17-ec4064300d48 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:23.179714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-874903d1-fce3-45e6-9fb2-6a5482fe5993 req-0866e7bc-7027-46e1-9f17-ec4064300d48 service nova] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:23.179714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-874903d1-fce3-45e6-9fb2-6a5482fe5993 req-0866e7bc-7027-46e1-9f17-ec4064300d48 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:23.179714 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-874903d1-fce3-45e6-9fb2-6a5482fe5993 req-0866e7bc-7027-46e1-9f17-ec4064300d48 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:23.179714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-874903d1-fce3-45e6-9fb2-6a5482fe5993 req-0866e7bc-7027-46e1-9f17-ec4064300d48 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Processing event network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:28:23.297654 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.299461 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.302056 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.320493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.321120 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:23.368127 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-changed-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:23.368310 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Refreshing instance network info cache due to event network-changed-4407a5c3-0f6e-4fdd-9519-586f16960f47. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:23.368513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] Acquiring lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:23.370348 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] Acquired lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:23.370348 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Refreshing network info cache for port 4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:23.778971 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646503.7785716, eb39b253-78ff-4768-aec4-cde1a39f1217 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:23.779489 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:28:23.779693 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] VM Started (Lifecycle Event)
May 13 04:28:23.782673 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:28:23.785351 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance spawned successfully.
May 13 04:28:23.785577 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:28:23.857574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found WWN 3300000002aaeed0b for multipath device dm-9 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:28:23.857962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:23.858160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000002aaeed0b', 'path': '/dev/dm-9', 'multipath_id': '3300000002aaeed0b'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:23.858479 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002aaeed0b', 'path': '/dev/dm-9', 'multipath_id': '3300000002aaeed0b'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:28:23.858747 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.937s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:23.859223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:28:23.861605 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:23.870712 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:23.874405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:23.875304 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:23.875908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:23.876099 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:23.876911 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:23.876911 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:23.892200 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:23.892200 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:23.897575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:28:23.897575 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:23.906958 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7] added
May 13 04:28:23.906958 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:23.906958 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:23.906958 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:23.906958 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:23.906958 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:23.906958 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:23.907153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:23.907393 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:23.907535 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7] added
May 13 04:28:23.910879 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:28:23.910879 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:28:23.910879 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:28:24.149621 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:24.264174 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updated VIF entry in instance network info cache for port 4407a5c3-0f6e-4fdd-9519-586f16960f47. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:28:24.264458 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating instance_info_cache with network_info: [{"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:24.282015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:24.284156 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:24.291274 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.291442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.291726 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.291973 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.292233 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.292666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:24.364277 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Attempting to attach volume c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:28:24.365481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:   <alias name="ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2"/>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:   <serial>c77ca55b-fe8c-4bc8-94e5-c8ca331971d2</serial>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]: </disk>
May 13 04:28:24.365481 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:28:24.766347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-ad9b31e1-8cde-4008-9536-87b389e59305 req-918cfbe0-8ee7-4471-b2f3-e165c0f44293 service nova] Releasing lock "refresh_cache-0007dd3e-b366-4789-84a8-6b7983f4375e" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:24.786288 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:28:24.786544 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646504.7863836, eb39b253-78ff-4768-aec4-cde1a39f1217 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:24.786701 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] VM Paused (Lifecycle Event)
May 13 04:28:24.796610 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Took 9.24 seconds to spawn the instance on the hypervisor.
May 13 04:28:24.796741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:24.909002 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:28:24.911120 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:24.923537 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:24.923537 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:28:24.930306 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:28:24.930306 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:24.938290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:24.949532 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.956277 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.956701 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.966823 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:24.967090 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:24.998825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.50.100,3260]
May 13 04:28:24.998825 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.50.100,3260] successful.
May 13 04:28:24.998825 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:25.008530 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.40.100,3260]
May 13 04:28:25.008530 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.40.100,3260] successful.
May 13 04:28:25.008530 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:25.016042 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:25.021591 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.034469 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.034832 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:25.035016 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:25.035105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:25.039814 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('15', '-', '-', 0) found on session 184 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:25.039953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.047309 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:25.047535 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:25.047799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:25.047799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:28:25.048635 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('16', '-', '-', 0) found on session 185 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:28:25.048757 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:28:25.057890 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 184 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:25.061998 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:25.064823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 185 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:28:25.064950 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:28:25.258862 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:25.259087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:25.259271 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:25.259436 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:25.259559 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] No waiting events found dispatching network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:25.259691 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-859bb137-c9bb-4869-9dbe-973432e93253 req-96f3c4c1-4973-4930-907d-27a732d651e2 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received unexpected event network-vif-plugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 for instance with vm_state active and task_state None.
May 13 04:28:25.288685 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:25.290462 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646505.2902915, eb39b253-78ff-4768-aec4-cde1a39f1217 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:25.290561 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] VM Resumed (Lifecycle Event)
May 13 04:28:25.305210 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Took 16.33 seconds to build instance.
May 13 04:28:25.325485 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:25.394685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:25.792981 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:25.794899 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:25.806416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.843s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:25.876722 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:28:26.002152 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:26.002794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:26.002794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:26.002794 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No VIF found with MAC fa:16:3e:80:bd:e0, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:28:26.891626 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Found WWN 330000000bcba85c5 for multipath device dm-12 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:28:26.892043 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:26.893014 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== connect_volume: return (3971ms) {'type': 'block', 'scsi_wwn': '330000000bcba85c5', 'path': '/dev/disk/by-id/os-brick+dev+dm-12', 'multipath_id': '330000000bcba85c5'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:26.893228 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bcba85c5', 'path': '/dev/disk/by-id/os-brick+dev+dm-12', 'multipath_id': '330000000bcba85c5'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:28:26.923440 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-12'}, 'status': 'reserved', 'instance': 'e7a51a0e-6750-4d15-8071-3505dcfb2101', 'attached_at': '', 'detached_at': '', 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'serial': '5f160363-518f-4ab6-a001-6debc0f3ccd7'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:28:26.923966 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:28:26.924156 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:28:26.924295 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:28:26.938334 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:28:26.938334 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:28:26.938334 np0000000669 nova-compute[97951]:     <volume>5f160363-518f-4ab6-a001-6debc0f3ccd7</volume>
May 13 04:28:26.938334 np0000000669 nova-compute[97951]:   </usage>
May 13 04:28:26.938334 np0000000669 nova-compute[97951]: </secret>
May 13 04:28:26.938334 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:28:27.446021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1097549913',display_name='tempest-TestEncryptedCinderVolumes-server-1097549913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1097549913',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-fwp6j4pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:20Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=e7a51a0e-6750-4d15-8071-3505dcfb2101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:28:27.446397 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:27.446825 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:27.447756 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'pci_devices' on Instance uuid e7a51a0e-6750-4d15-8071-3505dcfb2101 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:27.548458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-71fd69f8-a34e-46fe-8aa6-7819bab01d3a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.449s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:27.807060 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:27.807555 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing instance network info cache due to event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:27.807748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] Acquiring lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:27.807888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] Acquired lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:27.808030 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing network info cache for port 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:27.951467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] End _get_guest_xml xml=<domain type="qemu">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <uuid>e7a51a0e-6750-4d15-8071-3505dcfb2101</uuid>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <name>instance-00000047</name>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1097549913</nova:name>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:28:22</nova:creationTime>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:user uuid="cb359d584a0b41398ca70e7e57fd589f">tempest-TestEncryptedCinderVolumes-1387017513-project-member</nova:user>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:project uuid="7988aac1411045f0b97e046631509aac">tempest-TestEncryptedCinderVolumes-1387017513</nova:project>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <nova:port uuid="d1622c70-b119-4e98-8b2d-0c6911e548c3">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <system>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="serial">e7a51a0e-6750-4d15-8071-3505dcfb2101</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="uuid">e7a51a0e-6750-4d15-8071-3505dcfb2101</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </system>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <os>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </os>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <features>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </features>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   <devices>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/disk.config"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <alias name="ua-5f160363-518f-4ab6-a001-6debc0f3ccd7"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-12"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <serial>5f160363-518f-4ab6-a001-6debc0f3ccd7</serial>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <encryption format="luks">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:         <secret type="passphrase" uuid="f2a1083a-4871-4d4d-b248-20f02a1a0f28"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       </encryption>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:9e:6c:c8"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <target dev="tapd1622c70-b1"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </interface>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/console.log" append="off"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </serial>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <video>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </video>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </rng>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:   </devices>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]: </domain>
May 13 04:28:27.951467 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Preparing to wait for external event network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1097549913',display_name='tempest-TestEncryptedCinderVolumes-server-1097549913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1097549913',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-fwp6j4pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:20Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=e7a51a0e-6750-4d15-8071-3505dcfb2101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:27.954006 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:28:27.954807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.954807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:27.954934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:28:27.955703 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.955837 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17047bd0-fdb5-5a8a-9665-e1c101abde81', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:27.956624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.957646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:27.957646 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.959074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.959194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1622c70-b1, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:27.959481 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1622c70-b1, col_values=(('qos', UUID('4d7d0356-fee3-4331-b36e-62fdff058f49')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:27.959655 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1622c70-b1, col_values=(('external_ids', {'iface-id': 'd1622c70-b119-4e98-8b2d-0c6911e548c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:6c:c8', 'vm-uuid': 'e7a51a0e-6750-4d15-8071-3505dcfb2101'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:27.960284 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.961426 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:27.964776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:27.965727 np0000000669 nova-compute[97951]: INFO os_vif [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1')
May 13 04:28:28.310802 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:28.652065 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:28.776482 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updated VIF entry in instance network info cache for port 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:28:28.776769 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:29.278743 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0e063262-5e23-4d7a-8801-a056e75e6e3d req-024a34bc-bf65-4e61-b860-7d77f11274fe service nova] Releasing lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:29.481097 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:29.481271 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:29.481411 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No VIF found with MAC fa:16:3e:9e:6c:c8, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:28:29.481935 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Using config drive
May 13 04:28:29.987632 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:30.079039 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:30.079618 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:28:30.083651 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:30.083906 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:30.084128 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:30.098903 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Creating config drive at /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/disk.config
May 13 04:28:30.102619 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekok6mc6 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:30.152365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekok6mc6" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:30.326377 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.529900 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.565189 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.589641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:30.589918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:30.590116 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:30.590546 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:28:30.658683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.732758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9cd71848-dfb4-4e60-877c-b067da3af73f req-417e3d08-0e36-406e-89a9-10912275ec5d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:30.732758 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9cd71848-dfb4-4e60-877c-b067da3af73f req-417e3d08-0e36-406e-89a9-10912275ec5d service nova] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:30.732758 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9cd71848-dfb4-4e60-877c-b067da3af73f req-417e3d08-0e36-406e-89a9-10912275ec5d service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:30.732758 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9cd71848-dfb4-4e60-877c-b067da3af73f req-417e3d08-0e36-406e-89a9-10912275ec5d service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:30.732758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9cd71848-dfb4-4e60-877c-b067da3af73f req-417e3d08-0e36-406e-89a9-10912275ec5d service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Processing event network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:28:30.826925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.877695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.881645 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.882997 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:30.901897 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:31.779779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:31.874237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:31.875549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:31.965889 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:31.966451 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:28:31.972597 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:28:31.975626 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:28:31.978467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-12 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:28:31.981949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:28:31.987188 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:28:31.988250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:32.036645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:32.037268 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12922MB free_disk=72.7404670715332GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:28:32.037658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:32.037900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:32.441706 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646512.441095, e7a51a0e-6750-4d15-8071-3505dcfb2101 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:32.441983 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] VM Started (Lifecycle Event)
May 13 04:28:32.443724 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:28:32.447811 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:28:32.451497 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance spawned successfully.
May 13 04:28:32.451497 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:28:32.802966 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:32.803389 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:32.803487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:32.803587 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:32.803730 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] No waiting events found dispatching network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:32.803888 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-a29cd88b-23f0-45ee-831c-9ecc087f26be req-a33a9050-092b-4cad-ae07-ca5b587b2cee service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received unexpected event network-vif-plugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 for instance with vm_state building and task_state spawning.
May 13 04:28:32.944884 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:32.948548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:32.959265 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.959677 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.959894 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.960153 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.960477 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.960769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:28:32.973351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:33.101276 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 23f383b0-ad1a-4cb1-8afb-d792e9488982 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:28:33.101491 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:28:33.101546 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 0007dd3e-b366-4789-84a8-6b7983f4375e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:28:33.101603 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance eb39b253-78ff-4768-aec4-cde1a39f1217 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:28:33.101673 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e7a51a0e-6750-4d15-8071-3505dcfb2101 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:28:33.101832 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:28:33.101954 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:28:32 up 42 min,  2 users,  load average: 4.21, 5.94, 5.14\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_12dc09d5d69246b19f02313d2f4596e0': '2', 'io_workload': '1', 'num_proj_2beee2d64aaf4c20b3d265917ef6d0cb': '1', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_7988aac1411045f0b97e046631509aac': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:28:33.366222 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:33.366484 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:33.451855 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:28:33.452134 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646513.4519567, e7a51a0e-6750-4d15-8071-3505dcfb2101 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:33.452274 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] VM Paused (Lifecycle Event)
May 13 04:28:33.466401 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Took 10.57 seconds to spawn the instance on the hypervisor.
May 13 04:28:33.466933 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:33.869128 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:33.954973 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:33.957425 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646513.9571993, e7a51a0e-6750-4d15-8071-3505dcfb2101 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:33.957545 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] VM Resumed (Lifecycle Event)
May 13 04:28:33.980392 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Took 17.72 seconds to build instance.
May 13 04:28:34.375833 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:28:34.376551 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.338s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:34.376921 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:28:34.459708 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:34.462073 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:28:34.481980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.225s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:34.678165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:34.678373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:34.747992 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:35.181834 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Detaching volume c77ca55b-fe8c-4bc8-94e5-c8ca331971d2
May 13 04:28:35.223926 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Attempting to driver detach volume c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 from mountpoint /dev/vdb
May 13 04:28:35.231711 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found disk vdb by alias ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:28:35.233515 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found disk vdb by alias ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:28:35.233661 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Attempting to detach device vdb from instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:28:35.233939 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <alias name="ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2"/>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <serial>c77ca55b-fe8c-4bc8-94e5-c8ca331971d2</serial>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]: </disk>
May 13 04:28:35.233939 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:28:35.240055 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully detached device vdb from instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 from the persistent domain config.
May 13 04:28:35.240262 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] (1/8): Attempting to detach device vdb with device alias ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 from instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:28:35.240579 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <alias name="ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2"/>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-9"/>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <serial>c77ca55b-fe8c-4bc8-94e5-c8ca331971d2</serial>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]: </disk>
May 13 04:28:35.240579 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:28:35.327867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:35.376366 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:35.377016 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:35.377310 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.71 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:28:35.755088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646515.754608, 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 => ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:28:35.755847 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 for instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:28:35.758589 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully detached device vdb from instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 from the live domain config.
May 13 04:28:35.760645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:28:35.760998 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:35.761256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:35.761772 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:35.762121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:28:35.762293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:35.789612 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:35.789930 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:35.789930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '185')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:28:35.790164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', '182')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:35.791272 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', '183')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:35.792454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c6528e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'): ({'sdi'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:28:35.792699 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:28:35.792931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flush multipath device 3300000002aaeed0b {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:28:35.847053 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:28:35.888680 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:28:35.934486 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:28:35.934486 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:28:35.935421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:28:35.949698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:28:35.949939 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:28:35.966413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.007651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.40.100,3260]
May 13 04:28:36.007651 np0000000669 nova-compute[97951]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.40.100,3260] successful.
May 13 04:28:36.007651 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.015298 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-changed-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:36.017741 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Refreshing instance network info cache due to event network-changed-d1622c70-b119-4e98-8b2d-0c6911e548c3. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:36.017741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] Acquiring lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:36.017741 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] Acquired lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:36.017741 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Refreshing network info cache for port d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:36.029268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.042768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.076259 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.50.100,3260]
May 13 04:28:36.076259 np0000000669 nova-compute[97951]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, portal: 192.168.50.100,3260] successful.
May 13 04:28:36.076259 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.084165 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:36.084165 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:28:36.084626 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:28:36.093934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:28:36.094248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:36.094425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== disconnect_volume: return (333ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:36.094534 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:28:36.519029 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:36.650171 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:36.824696 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:36.979782 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updated VIF entry in instance network info cache for port d1622c70-b119-4e98-8b2d-0c6911e548c3. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:28:36.980221 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating instance_info_cache with network_info: [{"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:37.084754 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:28:37.085027 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:28:37.482605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b0799929-6da6-40b2-8cd6-cace595ec942 req-1874781d-f2f6-480f-9b9b-8400d4c3b156 service nova] Releasing lock "refresh_cache-e7a51a0e-6750-4d15-8071-3505dcfb2101" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:37.657020 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-11263234-3e49-440c-b8c1-e362a8026a48 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.979s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:37.657917 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.910s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:37.658918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:37.658918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:37.658918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:37.661862 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Terminating instance
May 13 04:28:37.975882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.166914 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:28:38.182644 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.187713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.202927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.207663 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.220719 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.230996 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:38.337828 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:38.338298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:38.338532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:38.338678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:38.338880 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] No waiting events found dispatching network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:38.338880 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-da506924-f3e5-4c54-9841-a6e1bad8c7a9 req-f417d36f-ca39-4453-9e5f-d94327b95e35 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:28:38.513256 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998487767999904 future=<Future at 0x7a464810a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:38.513658 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997991076999824 future=<Future at 0x7a464810a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:38.513850 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.997816807000163 future=<Future at 0x7a464810a390 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:38.515130 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Instance destroyed successfully.
May 13 04:28:38.515636 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'resources' on Instance uuid 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:39.017825 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1251728816',display_name='tempest-VolumesSnapshotTestJSON-instance-1251728816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1251728816',id=68,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL5TCYUUuX1e/aZcFKnYEMNhyOdb2SiuJi87Jvgqz/QuY/MUt+BKD0OhrEFLdbLcctxdJkvOuliKg4iQ5jPxL3HCNsgT3VINtK6WiG/sNExf8wPK/wFFhlTEA/NDsSR5Q==',key_name='tempest-keypair-1270976475',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:27:39Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-mimq9zvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=09d4ce84-6dd5-45cb-9b5b-42afca985ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:28:39.018271 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "address": "fa:16:3e:80:bd:e0", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac75c31-86", "ovs_interfaceid": "dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:39.018657 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:39.018892 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:28:39.020141 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.020392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdac75c31-86, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:39.021305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.022016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:39.022502 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.023209 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.023380 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4800094-ec1c-4bcd-88a2-92876ac4a561) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:39.023803 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.024237 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:39.024567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:39.026165 np0000000669 nova-compute[97951]: INFO os_vif [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:e0,bridge_name='br-int',has_traffic_filtering=True,id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac75c31-86')
May 13 04:28:39.027714 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:28:39.028114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:28:39.028248 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:28:39.028621 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:28:39.028867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:28:39.029014 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:39.053013 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:28:39.053362 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '185')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:28:39.053362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:39.053768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:28:39.053768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:28:39.053768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c77ca55b-fe8c-4bc8-94e5-c8ca331971d2') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:28:39.053768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c0c80e0>, {}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:28:39.053768 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Disconnecting from: [] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:28:39.053969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:28:39.054008 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== disconnect_volume: return (25ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:28:39.054112 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:28:39.054359 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Deleting instance files /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6_del
May 13 04:28:39.054974 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Deletion of /opt/stack/data/nova/instances/09d4ce84-6dd5-45cb-9b5b-42afca985ca6_del complete
May 13 04:28:39.561179 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:28:39.561913 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:28:39.562272 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:28:39.562387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:28:39.562609 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:39.648534 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:40.044836 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-978c0d24-0fac-44a7-9d83-61211be8d2bf req-10ba9029-41be-4e5f-80e9-b519fbe9f06e service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-deleted-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:40.045269 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-978c0d24-0fac-44a7-9d83-61211be8d2bf req-10ba9029-41be-4e5f-80e9-b519fbe9f06e service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Neutron deleted interface dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a; detaching it from the instance and deleting it from the info cache
May 13 04:28:40.045269 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-978c0d24-0fac-44a7-9d83-61211be8d2bf req-10ba9029-41be-4e5f-80e9-b519fbe9f06e service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:40.329727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:40.388985 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:40.389500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] Acquiring lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:40.389683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:40.390061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:40.390311 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] No waiting events found dispatching network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:28:40.390530 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f24d31f0-3cd4-4655-b51e-f9756eb6918b req-23f66371-58fd-4acb-9bb5-4b7ad44c85b3 service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Received event network-vif-unplugged-dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:28:40.496647 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:40.548810 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-978c0d24-0fac-44a7-9d83-61211be8d2bf req-10ba9029-41be-4e5f-80e9-b519fbe9f06e service nova] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Detach interface failed, port_id=dac75c31-86ad-4bf1-9c9a-2b21a7c3c53a, reason: Instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:28:40.998697 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Took 1.44 seconds to deallocate network for instance.
May 13 04:28:41.017366 np0000000669 nova-compute[97951]: WARNING nova.volume.cinder [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Attachment 6ccc1703-29ea-4cd7-91c5-8d04a9a1749d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6ccc1703-29ea-4cd7-91c5-8d04a9a1749d. (HTTP 404) (Request-ID: req-cb617144-50ff-4d92-8d90-ed061600d629)
May 13 04:28:41.017642 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Took 0.02 seconds to detach 1 volumes for instance.
May 13 04:28:41.524548 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:41.525009 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:41.806110 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:41.806469 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:42.308938 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:42.815340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.290s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:42.865530 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Deleted allocations for instance 09d4ce84-6dd5-45cb-9b5b-42afca985ca6
May 13 04:28:43.873362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e2097984-a41d-47b6-a326-134737aaebee tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "09d4ce84-6dd5-45cb-9b5b-42afca985ca6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.216s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:44.024890 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:45.344174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:49.025822 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:50.356807 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:50.542462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:50.542644 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:51.044443 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:28:51.593988 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:51.594400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:51.597476 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:28:51.597620 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Claim successful on node np0000000669
May 13 04:28:52.881594 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:28:52.882032 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:28:53.384471 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:28:53.512033 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00035825699978886405 future=<Future at 0x7a464810a390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:53.512545 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Emitting event <LifecycleEvent: 1778646518.5115514, 09d4ce84-6dd5-45cb-9b5b-42afca985ca6 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:28:53.512700 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:28:53.512830 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] VM Stopped (Lifecycle Event)
May 13 04:28:53.890568 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.296s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:53.891022 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:28:54.015400 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-cc348e79-970c-49cf-801e-24e3fb5d8c54 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 09d4ce84-6dd5-45cb-9b5b-42afca985ca6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:28:54.036734 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:54.395513 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:28:54.396410 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:28:54.396648 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:54.396904 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:54.468029 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4afc202e8f442f880bee837107aa232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beee2d64aaf4c20b3d265917ef6d0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:28:54.898027 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Successfully created port: 00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:28:54.899907 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:28:55.317374 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Successfully updated port: 00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:28:55.358482 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:55.365661 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-changed-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:28:55.365802 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Refreshing instance network info cache due to event network-changed-00e014d3-2162-4f07-9f80-d9d9ddbc2253. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:28:55.365924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] Acquiring lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:55.366013 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] Acquired lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:55.366106 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Refreshing network info cache for port 00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:28:55.403035 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:28:55.819623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:28:55.868148 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:55.926295 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:56.044571 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:56.409808 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:28:56.410618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:28:56.410842 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Creating image(s)
May 13 04:28:56.411268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:56.411427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:56.411835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:56.412863 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:28:56.415313 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:28:56.416085 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:56.503515 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:56.504024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:56.504566 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:56.505045 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:28:56.507440 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:28:56.507768 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:56.547556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2947694e-0954-427d-83fb-bbb2d83d4ed9 req-37a3bd6f-d4e8-4d6d-a6fb-2d4077d7dd08 service nova] Releasing lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:56.548505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquired lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:28:56.548782 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:28:56.601187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:56.601550 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:56.656916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk 1073741824" returned: 0 in 0.055s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:56.657462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:56.657839 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:56.748911 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:56.749419 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:28:56.749705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:28:56.843430 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:28:56.843826 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Cannot resize image /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:28:56.844370 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:28:56.844543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Ensure instance console log exists: /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:28:56.844810 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:56.845030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:56.845171 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:57.104908 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:28:57.235574 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:28:57.346409 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating instance_info_cache with network_info: [{"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:28:57.848931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Releasing lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:28:57.849212 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance network_info: |[{"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:28:57.850742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Start _get_guest_xml network_info=[{"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:28:57.860509 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:28:57.861638 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1822191914', uuid='479a32b6-b0ed-45ec-9456-d3f90ee619c6'), owner=OwnerMeta(userid='e4afc202e8f442f880bee837107aa232', username='tempest-VolumesSnapshotTestJSON-85989347-project-member', projectid='2beee2d64aaf4c20b3d265917ef6d0cb', projectname='tempest-VolumesSnapshotTestJSON-85989347'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646537.8613358) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:28:57.862746 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:28:57.863105 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:28:57.864419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:28:57.864419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:28:57.865172 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:28:57.865462 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:28:57.865593 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:28:57.865688 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:28:57.865806 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:28:57.868351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:28:57.880024 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1822191914',display_name='tempest-VolumesSnapshotTestJSON-instance-1822191914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1822191914',id=72,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgCz1hFdvmpggXEBFrUMIUh4BWDYP4P2hgZaFpLDaKWv8G9Y6XHUg5k3TbQyMOTN7SSplyBE4KyLq15lBJj6ZCHYwk40+7q+un2cUiLgwlDyDliky3cLN78jhGhlbIo4g==',key_name='tempest-keypair-591965143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-an7e3oql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=479a32b6-b0ed-45ec-9456-d3f90ee619c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:28:57.880262 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:57.881028 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:57.881773 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'pci_devices' on Instance uuid 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:28:58.384536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] End _get_guest_xml xml=<domain type="qemu">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <uuid>479a32b6-b0ed-45ec-9456-d3f90ee619c6</uuid>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <name>instance-00000048</name>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1822191914</nova:name>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:28:57</nova:creationTime>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:user uuid="e4afc202e8f442f880bee837107aa232">tempest-VolumesSnapshotTestJSON-85989347-project-member</nova:user>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:project uuid="2beee2d64aaf4c20b3d265917ef6d0cb">tempest-VolumesSnapshotTestJSON-85989347</nova:project>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         <nova:port uuid="00e014d3-2162-4f07-9f80-d9d9ddbc2253">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <system>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="serial">479a32b6-b0ed-45ec-9456-d3f90ee619c6</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="uuid">479a32b6-b0ed-45ec-9456-d3f90ee619c6</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </system>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <os>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </os>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <features>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </features>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   <devices>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.config"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </disk>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:db:b9:25"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <target dev="tap00e014d3-21"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </interface>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/console.log" append="off"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </serial>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <video>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </video>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </rng>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:   </devices>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]: </domain>
May 13 04:28:58.384536 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Preparing to wait for external event network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1822191914',display_name='tempest-VolumesSnapshotTestJSON-instance-1822191914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1822191914',id=72,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgCz1hFdvmpggXEBFrUMIUh4BWDYP4P2hgZaFpLDaKWv8G9Y6XHUg5k3TbQyMOTN7SSplyBE4KyLq15lBJj6ZCHYwk40+7q+un2cUiLgwlDyDliky3cLN78jhGhlbIo4g==',key_name='tempest-keypair-591965143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-an7e3oql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=479a32b6-b0ed-45ec-9456-d3f90ee619c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:58.388697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:28:58.389275 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.389468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f301f22-542d-5c37-879b-18f283c3edbc', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:58.390255 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.390992 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:58.391242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.393012 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.393160 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00e014d3-21, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:58.393531 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00e014d3-21, col_values=(('qos', UUID('e7c0f5a6-8d09-4c8a-80c0-355d6a96dfd2')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:58.393739 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00e014d3-21, col_values=(('external_ids', {'iface-id': '00e014d3-2162-4f07-9f80-d9d9ddbc2253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:b9:25', 'vm-uuid': '479a32b6-b0ed-45ec-9456-d3f90ee619c6'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:28:58.394446 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.395458 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:28:58.399778 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:28:58.400628 np0000000669 nova-compute[97951]: INFO os_vif [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21')
May 13 04:28:59.915512 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:59.916012 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:28:59.916012 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No VIF found with MAC fa:16:3e:db:b9:25, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:28:59.916250 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Using config drive
May 13 04:29:00.360242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:00.420960 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:00.536523 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Creating config drive at /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.config
May 13 04:29:00.543869 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ginkmo6 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:00.595745 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ginkmo6" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:01.004695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.027665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.027665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.114470 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.175231 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-82001ab7-cbaa-4f05-a175-32d6375b40a2 req-5f876c98-525c-4c04-8825-d0737e454388 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:01.175538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-82001ab7-cbaa-4f05-a175-32d6375b40a2 req-5f876c98-525c-4c04-8825-d0737e454388 service nova] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:01.175742 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-82001ab7-cbaa-4f05-a175-32d6375b40a2 req-5f876c98-525c-4c04-8825-d0737e454388 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:01.176416 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-82001ab7-cbaa-4f05-a175-32d6375b40a2 req-5f876c98-525c-4c04-8825-d0737e454388 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:01.176558 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-82001ab7-cbaa-4f05-a175-32d6375b40a2 req-5f876c98-525c-4c04-8825-d0737e454388 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Processing event network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:29:01.306931 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.313148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.313148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.331765 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:01.786055 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646541.7855878, 479a32b6-b0ed-45ec-9456-d3f90ee619c6 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:01.786666 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:29:01.787599 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] VM Started (Lifecycle Event)
May 13 04:29:01.790942 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:29:01.795579 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance spawned successfully.
May 13 04:29:01.795900 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:29:02.290441 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:02.292905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:02.301628 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.301743 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.302019 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.302252 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.302542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.302805 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:02.796176 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:29:02.796176 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646542.7956214, 479a32b6-b0ed-45ec-9456-d3f90ee619c6 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:02.796176 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] VM Paused (Lifecycle Event)
May 13 04:29:02.807657 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Took 6.40 seconds to spawn the instance on the hypervisor.
May 13 04:29:02.807827 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:03.231615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:03.232088 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:03.232235 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:03.232431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:03.232618 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] No waiting events found dispatching network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:03.232801 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c554680d-cec6-4c44-ae69-5e5d9516027c req-4062a68f-fed6-4903-9b96-37cd9047f3ef service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received unexpected event network-vif-plugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 for instance with vm_state active and task_state None.
May 13 04:29:03.299437 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:03.303065 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646543.3013568, 479a32b6-b0ed-45ec-9456-d3f90ee619c6 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:03.303065 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] VM Resumed (Lifecycle Event)
May 13 04:29:03.315971 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Took 11.77 seconds to build instance.
May 13 04:29:03.395784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:03.805241 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:03.807075 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:03.817787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-aec7c4f8-b894-4309-8e8f-eafb75f6f675 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.275s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:04.622357 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-changed-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:04.622357 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Refreshing instance network info cache due to event network-changed-00e014d3-2162-4f07-9f80-d9d9ddbc2253. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:04.622357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] Acquiring lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:04.622357 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] Acquired lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:04.622357 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Refreshing network info cache for port 00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:05.126021 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:05.361420 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:05.498569 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:05.652234 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updated VIF entry in instance network info cache for port 00e014d3-2162-4f07-9f80-d9d9ddbc2253. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:29:05.653484 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating instance_info_cache with network_info: [{"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:05.897202 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:05.897598 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:06.155701 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c294c196-072c-4451-8ec9-c5aecf7d079f req-fcf4d6be-41db-4c83-baed-c2b63daf2b7f service nova] Releasing lock "refresh_cache-479a32b6-b0ed-45ec-9456-d3f90ee619c6" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:06.399140 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:29:06.957614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:06.958072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:06.962017 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:29:06.962215 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Claim successful on node np0000000669
May 13 04:29:08.210660 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:08.211019 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:08.312444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:29:08.312694 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:29:08.411612 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:08.713052 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:29:08.815353 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:29:09.257984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:09.323903 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.366s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:09.324106 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:29:09.325980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.069s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:09.329046 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:29:09.329153 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Claim successful on node np0000000669
May 13 04:29:09.830365 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:29:09.830586 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:29:09.830962 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:09.831764 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:09.929112 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9431469bdf974894a3493b27bb04be38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc09d5d69246b19f02313d2f4596e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:29:10.342382 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:29:10.362296 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:10.424429 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Successfully created port: 28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:29:10.768021 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:29:10.768234 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:29:10.845639 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:29:10.878262 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Successfully updated port: 28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:29:10.945950 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-changed-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:10.946467 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Refreshing instance network info cache due to event network-changed-28d4c797-9772-475f-9927-5f722698ef9d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:10.946467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] Acquiring lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:10.946547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] Acquired lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:10.946612 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Refreshing network info cache for port 28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:11.270764 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:29:11.349604 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Booting with volume b1fc7200-a2eb-462f-a3b6-2650c55ee397 at /dev/vda
May 13 04:29:11.379955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:11.387464 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:11.397823 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:29:11.420717 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:11.450672 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:11.482071 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:29:11.482362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:29:11.491010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:29:11.492468 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe41:92aa', 'fe80::fc16:3eff:fedd:6b81', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe9e:6cc8', 'fe80::b4da:96ff:fe34:f9b4', 'fe80::fc16:3eff:fedb:b925', 'fe80::4474:a5ff:fe48:e7d9'] 
May 13 04:29:11.492803 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:29:11.492938 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:29:11.493254 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:11.493550 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updating existing volume attachment record: e97a7c57-a401-41f2-bb25-50bc5ec5c907 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:29:11.521224 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:11.667464 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:11.776799 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.451s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:11.777219 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:29:12.170873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-97a5b7ac-5ae1-460c-a6fd-f8ad5c98103e req-aea83bb9-cb5a-4fae-a2d9-bd8bcc7c822b service nova] Releasing lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:12.172119 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquired lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:12.172119 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:29:12.282699 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:29:12.283476 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:29:12.283721 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:12.283934 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:12.352394 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059a5dddf67c4a9a9a53c500c0b81a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740f7c9f5d174dbab93ae09d1cad017d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:29:12.735870 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:12.786388 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:29:12.878503 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Successfully created port: 3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:29:12.902473 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:13.069141 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updating instance_info_cache with network_info: [{"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:13.296981 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:29:13.401074 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Successfully updated port: 3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:29:13.414449 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:13.447378 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:13.447729 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing instance network info cache due to event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:13.448198 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] Acquiring lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:13.448404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] Acquired lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:13.448594 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing network info cache for port 3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:13.522868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:13.523004 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:13.523168 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:13.523289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:13.523402 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:13.525427 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Terminating instance
May 13 04:29:13.572988 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Releasing lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:13.573313 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance network_info: |[{"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:29:13.597846 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:29:13.599031 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:29:13.599255 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Creating image(s)
May 13 04:29:13.599549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:29:13.599670 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Ensure instance console log exists: /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:29:13.599883 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:13.600027 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:13.600150 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:13.600570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Start _get_guest_xml network_info=[{"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3a75a13d-02b8-40d7-8a54-ab864a097576', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'serial': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397'}, 'disk_bus': 'virtio', 'attachment_id': 'e97a7c57-a401-41f2-bb25-50bc5ec5c907', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:29:13.604151 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:29:13.604984 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-217634504', uuid='3a75a13d-02b8-40d7-8a54-ab864a097576'), owner=OwnerMeta(userid='9431469bdf974894a3493b27bb04be38', username='tempest-TestVolumeBootPatternV346-1311400665-project-member', projectid='12dc09d5d69246b19f02313d2f4596e0', projectname='tempest-TestVolumeBootPatternV346-1311400665'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646553.604706) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:29:13.605911 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:29:13.606183 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:29:13.606941 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:29:13.607109 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:29:13.607867 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:29:13.608107 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:29:13.608246 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:29:13.608351 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:29:13.608466 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:29:13.608861 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:29:13.608861 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:29:13.608861 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:29:13.608861 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:29:13.609058 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:29:13.609058 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:29:13.609140 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:29:13.618452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:29:13.618724 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:13.618847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:13.619164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:13.619362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:29:13.632204 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:13.632700 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:13.633386 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:13.633693 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:13.634045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:13.634211 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:13.647776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:13.647776 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:13.652132 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:13.652132 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:13.658618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397] added
May 13 04:29:13.658618 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:13.658618 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:13.658618 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:13.658618 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:13.658618 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:13.658618 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:13.658813 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:13.658915 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:13.659052 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:13.664316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397] added
May 13 04:29:13.664316 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:13.664316 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:13.664316 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:13.664316 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:13.664316 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:13.664316 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:13.664551 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:13.664671 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:13.664827 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:13.806918 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Booting with volume 6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 at /dev/vda
May 13 04:29:13.845579 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:13.857035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:29:13.875216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:13.904432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:13.914135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:29:13.914418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:29:13.922553 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:29:13.924660 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe41:92aa', 'fe80::fc16:3eff:fedd:6b81', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fe9e:6cc8', 'fe80::b4da:96ff:fe34:f9b4', 'fe80::fc16:3eff:fedb:b925', 'fe80::4474:a5ff:fe48:e7d9'] 
May 13 04:29:13.924835 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:29:13.924940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:29:13.925145 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:13.925356 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating existing volume attachment record: b6cfb379-c5fa-484f-bb1e-29685a6e4a2f {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:29:13.950945 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:14.014747 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:14.028409 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:29:14.058684 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.074004 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.076893 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.097721 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.198507 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:14.333799 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.340586 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.359578 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.9996327570002 future=<Future at 0x7a4648576c30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:29:14.359578 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999313832000098 future=<Future at 0x7a4648576c30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:29:14.359760 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999179836000167 future=<Future at 0x7a4648576c30 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:29:14.360698 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Instance destroyed successfully.
May 13 04:29:14.361092 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'resources' on Instance uuid e7a51a0e-6750-4d15-8071-3505dcfb2101 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:14.659772 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:14.665258 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:14.672888 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:14.672888 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:14.681071 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:14.681071 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.686121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.692156 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.699534 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.700081 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:14.700735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-198cd784-17b8-4e24-b081-16521c5c62bb req-7599d591-bf3d-4304-afd4-92d707fbe7db service nova] Releasing lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:14.701352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquired lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:14.701564 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.709007 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.709415 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:14.744340 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.50.100,3260]
May 13 04:29:14.744340 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.50.100,3260] successful.
May 13 04:29:14.744340 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.756104 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.765565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.40.100,3260]
May 13 04:29:14.765565 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.40.100,3260] successful.
May 13 04:29:14.765565 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.774006 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.774391 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:14.774600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:14.774671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:14.776193 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('13', '-', '-', 0) found on session 186 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:14.776366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:14.781616 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:14.793830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 186 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:14.793830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.800851 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:14.801351 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:14.801351 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:14.801903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:14.802439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] HCTL ('14', '-', '-', 0) found on session 187 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:14.802536 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:14.819652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Searching for a device in session 187 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:14.819652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:14.863668 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1097549913',display_name='tempest-TestEncryptedCinderVolumes-server-1097549913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-1097549913',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:28:33Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-fwp6j4pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:28:34Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=e7a51a0e-6750-4d15-8071-3505dcfb2101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:29:14.863872 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "address": "fa:16:3e:9e:6c:c8", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1622c70-b1", "ovs_interfaceid": "d1622c70-b119-4e98-8b2d-0c6911e548c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:14.864499 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:14.864752 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:29:14.866350 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.866590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1622c70-b1, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:14.868267 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.868989 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:14.869965 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.870158 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d7d0356-fee3-4331-b36e-62fdff058f49) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:14.873791 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:14.875656 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:14.883462 np0000000669 nova-compute[97951]: INFO os_vif [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6c:c8,bridge_name='br-int',has_traffic_filtering=True,id=d1622c70-b119-4e98-8b2d-0c6911e548c3,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1622c70-b1')
May 13 04:29:14.888526 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:29:14.888889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:14.889088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:15.267551 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:15.371129 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:15.431181 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:15.512776 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] No waiting events found dispatching network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Acquiring lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:15.517594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:15.517976 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:15.517976 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] No waiting events found dispatching network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:15.518049 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f8574ce-d6c3-43e2-abdc-d4eda0607f7b req-b4c235b0-a049-4786-9e2a-971309d6bab7 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-unplugged-d1622c70-b119-4e98-8b2d-0c6911e548c3 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:29:15.556023 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:15.634203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:29:16.028017 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:29:16.029040 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:29:16.029276 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Creating image(s)
May 13 04:29:16.029542 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:29:16.029655 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Ensure instance console log exists: /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:29:16.029851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:16.030060 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:16.030194 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:16.061630 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Releasing lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:16.062367 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance network_info: |[{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:29:16.062561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Start _get_guest_xml network_info=[{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5abe25a8-40b0-45e4-8f4c-416b0445f5ca', 'attached_at': '', 'detached_at': '', 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'serial': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'}, 'disk_bus': 'virtio', 'attachment_id': 'b6cfb379-c5fa-484f-bb1e-29685a6e4a2f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:29:16.064908 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:29:16.066196 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-610812140', uuid='5abe25a8-40b0-45e4-8f4c-416b0445f5ca'), owner=OwnerMeta(userid='059a5dddf67c4a9a9a53c500c0b81a3c', username='tempest-TestVolumeBootPattern-722735240-project-member', projectid='740f7c9f5d174dbab93ae09d1cad017d', projectname='tempest-TestVolumeBootPattern-722735240'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646556.0658314) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:29:16.067314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:29:16.067680 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:29:16.068617 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:29:16.068799 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:29:16.069812 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:29:16.070138 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:29:16.070316 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:29:16.070451 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:29:16.070600 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:29:16.070715 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:29:16.070830 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:29:16.071015 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:29:16.071140 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:29:16.071285 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:29:16.071434 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:29:16.071577 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:29:16.085333 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:29:16.085628 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:16.085773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:16.650943 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Found WWN 33000000038a52d6d for multipath device dm-9 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:29:16.651306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:16.651502 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000038a52d6d', 'path': '/dev/dm-9', 'multipath_id': '33000000038a52d6d'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:16.651643 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000038a52d6d', 'path': '/dev/dm-9', 'multipath_id': '33000000038a52d6d'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:29:16.652089 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.763s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:16.652506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f160363-518f-4ab6-a001-6debc0f3ccd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:29:16.652671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:16.681490 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:16.681850 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:16.681850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '187')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:29:16.682268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '185')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:29:16.683692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7', '184')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:29:16.684717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12f7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:29:16.684931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:29:16.685203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flush multipath device 330000000bcba85c5 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:29:16.720996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:29:16.783548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:29:16.837723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:29:16.837931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:29:16.839874 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:29:16.854352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:29:16.854352 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:29:16.868203 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.901915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.40.100,3260]
May 13 04:29:16.901915 np0000000669 nova-compute[97951]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.40.100,3260] successful.
May 13 04:29:16.901915 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.919254 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.933367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.967345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.50.100,3260]
May 13 04:29:16.967345 np0000000669 nova-compute[97951]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-5f160363-518f-4ab6-a001-6debc0f3ccd7, portal: 192.168.50.100,3260] successful.
May 13 04:29:16.967345 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.988000 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:16.988921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:16.989059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== disconnect_volume: return (2100ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:16.989302 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:29:16.989673 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Deleting instance files /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101_del
May 13 04:29:16.989979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.904s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:16.990310 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:29:16.991019 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Deletion of /opt/stack/data/nova/instances/e7a51a0e-6750-4d15-8071-3505dcfb2101_del complete
May 13 04:29:17.004902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:17.005508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:17.006362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:17.006362 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:17.006820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:17.006820 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:17.017353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:17.017353 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:17.024646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:17.024646 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:17.029472 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7] added
May 13 04:29:17.029472 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:17.029472 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:17.029472 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:17.029472 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:17.029472 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:17.029472 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:17.030267 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:17.030267 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:17.030267 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:17.034708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7] added
May 13 04:29:17.034708 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:17.034708 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:17.034708 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:17.034708 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:17.034708 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:17.034708 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:17.035030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:17.035030 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:17.035205 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:17.157771 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-217634504',display_name='tempest-TestVolumeBootPatternV346-server-217634504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-217634504',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5GvA9OXRE4lSFX93DOssmcBZnr1brpf069F6NTYSZLcO1Gv7MsDobXwyAT+blVxhUQ67fvE44WOKxcByXq5hJlnoktfujpx6PYU5Hbd5PPc722mTXFAn3SXR0fiWbeog==',key_name='tempest-keypair-25255921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-si7uj032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=3a75a13d-02b8-40d7-8a54-ab864a097576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:29:17.158058 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:17.158664 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:17.159315 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a75a13d-02b8-40d7-8a54-ab864a097576 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:17.497472 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Took 3.47 seconds to destroy the instance on the hypervisor.
May 13 04:29:17.498073 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:29:17.498412 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:29:17.498505 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:29:17.498748 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:17.565705 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:17.662298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] End _get_guest_xml xml=<domain type="qemu">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <uuid>3a75a13d-02b8-40d7-8a54-ab864a097576</uuid>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <name>instance-00000049</name>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPatternV346-server-217634504</nova:name>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:29:13</nova:creationTime>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:user uuid="9431469bdf974894a3493b27bb04be38">tempest-TestVolumeBootPatternV346-1311400665-project-member</nova:user>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:project uuid="12dc09d5d69246b19f02313d2f4596e0">tempest-TestVolumeBootPatternV346-1311400665</nova:project>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         <nova:port uuid="28d4c797-9772-475f-9927-5f722698ef9d">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <system>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="serial">3a75a13d-02b8-40d7-8a54-ab864a097576</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="uuid">3a75a13d-02b8-40d7-8a54-ab864a097576</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </system>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <os>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </os>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <features>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </features>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   <devices>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/disk.config"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <alias name="ua-b1fc7200-a2eb-462f-a3b6-2650c55ee397"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-9"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <serial>b1fc7200-a2eb-462f-a3b6-2650c55ee397</serial>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:ca:f8:01"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <target dev="tap28d4c797-97"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </interface>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/console.log" append="off"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </serial>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <video>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </video>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </rng>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:   </devices>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]: </domain>
May 13 04:29:17.662298 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Preparing to wait for external event network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-217634504',display_name='tempest-TestVolumeBootPatternV346-server-217634504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-217634504',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5GvA9OXRE4lSFX93DOssmcBZnr1brpf069F6NTYSZLcO1Gv7MsDobXwyAT+blVxhUQ67fvE44WOKxcByXq5hJlnoktfujpx6PYU5Hbd5PPc722mTXFAn3SXR0fiWbeog==',key_name='tempest-keypair-25255921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-si7uj032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=3a75a13d-02b8-40d7-8a54-ab864a097576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:17.664513 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:17.664820 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:29:17.665169 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.665443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:17.665683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:29:17.666433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.666616 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '427fbd70-0f87-5df2-a60f-453b7e781dc6', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:17.674860 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.675768 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:17.676440 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.678754 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.678990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28d4c797-97, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:17.679477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28d4c797-97, col_values=(('qos', UUID('0d32bff8-17fa-401b-a8c4-0c33b04b02c8')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:17.680010 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28d4c797-97, col_values=(('external_ids', {'iface-id': '28d4c797-9772-475f-9927-5f722698ef9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:f8:01', 'vm-uuid': '3a75a13d-02b8-40d7-8a54-ab864a097576'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:17.681071 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.682487 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:17.692185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:17.693203 np0000000669 nova-compute[97951]: INFO os_vif [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97')
May 13 04:29:18.030551 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:18.036537 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:18.044054 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f2f05fa-bb81-45cf-856d-cbf86ae79813 req-96af8c16-9226-4698-a632-7ea8fa293b65 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Received event network-vif-deleted-d1622c70-b119-4e98-8b2d-0c6911e548c3 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:18.045079 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-0f2f05fa-bb81-45cf-856d-cbf86ae79813 req-96af8c16-9226-4698-a632-7ea8fa293b65 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Neutron deleted interface d1622c70-b119-4e98-8b2d-0c6911e548c3; detaching it from the instance and deleting it from the info cache
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:18.046235 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:18.046235 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.052174 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0f2f05fa-bb81-45cf-856d-cbf86ae79813 req-96af8c16-9226-4698-a632-7ea8fa293b65 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:18.056640 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:18.056640 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.065498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.074605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.084855 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.085054 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.095820 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.096121 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:18.132195 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.50.100,3260]
May 13 04:29:18.132195 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.50.100,3260] successful.
May 13 04:29:18.132195 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.147671 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.159725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.40.100,3260]
May 13 04:29:18.159725 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.40.100,3260] successful.
May 13 04:29:18.159725 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.168153 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.168444 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:18.168623 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:18.168623 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:18.169588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('15', '-', '-', 0) found on session 188 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:18.169720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:18.175618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:18.186892 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 188 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:18.186892 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.194940 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:18.195291 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:18.195600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:18.195600 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:18.196473 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] HCTL ('16', '-', '-', 0) found on session 189 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:18.196597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:18.212508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Searching for a device in session 189 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:18.212508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:18.483621 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:18.555866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f2f05fa-bb81-45cf-856d-cbf86ae79813 req-96af8c16-9226-4698-a632-7ea8fa293b65 service nova] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Detach interface failed, port_id=d1622c70-b119-4e98-8b2d-0c6911e548c3, reason: Instance e7a51a0e-6750-4d15-8071-3505dcfb2101 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:29:18.985495 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Took 1.49 seconds to deallocate network for instance.
May 13 04:29:19.006933 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:29:19.211742 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:19.212179 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:19.212179 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] No VIF found with MAC fa:16:3e:ca:f8:01, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:29:19.212451 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Using config drive
May 13 04:29:19.527350 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Took 0.54 seconds to detach 1 volumes for instance.
May 13 04:29:19.718099 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:19.829846 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Creating config drive at /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/disk.config
May 13 04:29:19.833909 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp42k967vc {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:19.889472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp42k967vc" returned: 0 in 0.055s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:20.021664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Found WWN 33000000059d61575 for multipath device dm-12 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:29:20.022121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:20.022298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== connect_volume: return (3936ms) {'type': 'block', 'scsi_wwn': '33000000059d61575', 'path': '/dev/dm-12', 'multipath_id': '33000000059d61575'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:20.022476 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000059d61575', 'path': '/dev/dm-12', 'multipath_id': '33000000059d61575'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:29:20.032888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:20.033146 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:20.290438 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.312112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.361995 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:29:20.362343 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:29:20.371721 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.407943 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.421266 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.422462 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:20.472101 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0037a664-7321-4553-b9f9-96bfba75243a req-26a70ed3-9881-4996-ad0c-e249b3713a74 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:20.473174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0037a664-7321-4553-b9f9-96bfba75243a req-26a70ed3-9881-4996-ad0c-e249b3713a74 service nova] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:20.473174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0037a664-7321-4553-b9f9-96bfba75243a req-26a70ed3-9881-4996-ad0c-e249b3713a74 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:20.473174 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0037a664-7321-4553-b9f9-96bfba75243a req-26a70ed3-9881-4996-ad0c-e249b3713a74 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:20.473174 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0037a664-7321-4553-b9f9-96bfba75243a req-26a70ed3-9881-4996-ad0c-e249b3713a74 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Processing event network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:29:20.530131 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-610812140',display_name='tempest-TestVolumeBootPattern-server-610812140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-610812140',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-9dwfzjfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:13Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=5abe25a8-40b0-45e4-8f4c-416b0445f5ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:29:20.531077 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:20.531393 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:20.532213 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'pci_devices' on Instance uuid 5abe25a8-40b0-45e4-8f4c-416b0445f5ca {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:20.865843 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:29:21.006651 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646561.0062463, 3a75a13d-02b8-40d7-8a54-ab864a097576 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:21.006823 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] VM Started (Lifecycle Event)
May 13 04:29:21.008148 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:29:21.010261 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:29:21.013125 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance spawned successfully.
May 13 04:29:21.013419 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:29:21.035654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] End _get_guest_xml xml=<domain type="qemu">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <uuid>5abe25a8-40b0-45e4-8f4c-416b0445f5ca</uuid>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <name>instance-0000004a</name>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestVolumeBootPattern-server-610812140</nova:name>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:29:16</nova:creationTime>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:user uuid="059a5dddf67c4a9a9a53c500c0b81a3c">tempest-TestVolumeBootPattern-722735240-project-member</nova:user>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:project uuid="740f7c9f5d174dbab93ae09d1cad017d">tempest-TestVolumeBootPattern-722735240</nova:project>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         <nova:port uuid="3e797080-fa84-4df7-b5f5-51ed3db3eab8">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <system>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="serial">5abe25a8-40b0-45e4-8f4c-416b0445f5ca</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="uuid">5abe25a8-40b0-45e4-8f4c-416b0445f5ca</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </system>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <os>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </os>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <features>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </features>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   <devices>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/disk.config"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <alias name="ua-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-12"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <serial>6f58afb0-4eba-49f0-8e35-da7e67cdb9d7</serial>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:a4:91:b7"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <target dev="tap3e797080-fa"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </interface>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/console.log" append="off"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </serial>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <video>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </video>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </rng>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:   </devices>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]: </domain>
May 13 04:29:21.035654 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Preparing to wait for external event network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-610812140',display_name='tempest-TestVolumeBootPattern-server-610812140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-610812140',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-9dwfzjfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:13Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=5abe25a8-40b0-45e4-8f4c-416b0445f5ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:21.038281 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:29:21.038735 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.039418 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:21.039574 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:29:21.040416 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.040556 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ceafae65-d6d3-5f69-9f30-5479ee76b177', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:21.041358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.041891 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:21.042475 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.044305 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.044445 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e797080-fa, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:21.044718 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e797080-fa, col_values=(('qos', UUID('f70a1230-e55c-47ac-8ad9-edcafee59785')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:21.044856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e797080-fa, col_values=(('external_ids', {'iface-id': '3e797080-fa84-4df7-b5f5-51ed3db3eab8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:91:b7', 'vm-uuid': '5abe25a8-40b0-45e4-8f4c-416b0445f5ca'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:21.045519 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.046532 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:21.051311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:21.052228 np0000000669 nova-compute[97951]: INFO os_vif [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa')
May 13 04:29:21.374505 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.341s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:21.422468 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deleted allocations for instance e7a51a0e-6750-4d15-8071-3505dcfb2101
May 13 04:29:21.509249 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:21.512120 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:21.519534 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:21.519677 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:21.519886 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:21.520088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:21.520297 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:21.520510 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:22.014208 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:29:22.014443 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646562.0142763, 3a75a13d-02b8-40d7-8a54-ab864a097576 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:22.014549 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] VM Paused (Lifecycle Event)
May 13 04:29:22.024606 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Took 8.43 seconds to spawn the instance on the hypervisor.
May 13 04:29:22.024894 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:22.433915 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4128364b-720a-42ce-8ee2-0be8de9cb355 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "e7a51a0e-6750-4d15-8071-3505dcfb2101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.911s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:22.516710 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:22.519006 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646562.5187633, 3a75a13d-02b8-40d7-8a54-ab864a097576 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:22.519133 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] VM Resumed (Lifecycle Event)
May 13 04:29:22.526501 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:22.527628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:22.527628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:22.527628 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:22.527628 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] No waiting events found dispatching network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:22.527628 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-537a1796-d74d-46cb-ac8a-2d60aab6b58b req-09ce7de6-026a-4b80-af3c-9b2d40620924 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received unexpected event network-vif-plugged-28d4c797-9772-475f-9927-5f722698ef9d for instance with vm_state active and task_state None.
May 13 04:29:22.532128 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Took 15.63 seconds to build instance.
May 13 04:29:22.570206 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:22.570337 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:22.570481 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] No VIF found with MAC fa:16:3e:a4:91:b7, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:29:22.570873 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Using config drive
May 13 04:29:23.021542 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:23.023681 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:23.033929 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.136s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:23.076331 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:23.204508 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Creating config drive at /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/disk.config
May 13 04:29:23.207429 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfy2igdh1 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:23.260568 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfy2igdh1" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:23.660183 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-changed-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:23.660634 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Refreshing instance network info cache due to event network-changed-28d4c797-9772-475f-9927-5f722698ef9d. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:23.660634 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] Acquiring lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:23.660708 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] Acquired lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:23.660799 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Refreshing network info cache for port 28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:23.667338 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:23.689702 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:23.692585 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:23.791314 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:23.806792 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:23.807772 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:24.166595 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:24.431476 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646564.4310725, 5abe25a8-40b0-45e4-8f4c-416b0445f5ca => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:24.431752 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] VM Started (Lifecycle Event)
May 13 04:29:24.434953 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:24.552550 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updated VIF entry in instance network info cache for port 28d4c797-9772-475f-9927-5f722698ef9d. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:29:24.552832 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updating instance_info_cache with network_info: [{"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:24.578065 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:24.578487 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:24.579451 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:24.579614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:24.579822 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Processing event network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:29:24.579911 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:24.580072 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:24.580414 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:29:24.580579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:24.580706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:24.580844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] No waiting events found dispatching network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:24.581006 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-fe71ad86-63db-4bd0-97e5-2edcd47fbfb5 req-54c0c719-a908-44a0-a23d-0ca8a897750b service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received unexpected event network-vif-plugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 for instance with vm_state building and task_state spawning.
May 13 04:29:24.583853 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:29:24.589546 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance spawned successfully.
May 13 04:29:24.589772 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:29:24.935994 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:24.938273 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:25.054831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0c58dd87-9d1b-429b-a27e-639079a23279 req-9dbe5239-8003-40f0-a30e-0ec9ce897176 service nova] Releasing lock "refresh_cache-3a75a13d-02b8-40d7-8a54-ab864a097576" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:25.097927 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.098040 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.098406 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.098658 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.099001 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.099319 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:25.384483 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:25.440338 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:29:25.440601 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646565.4404263, 5abe25a8-40b0-45e4-8f4c-416b0445f5ca => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:25.440750 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] VM Paused (Lifecycle Event)
May 13 04:29:25.605657 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Took 9.58 seconds to spawn the instance on the hypervisor.
May 13 04:29:25.605831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:25.943206 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:25.945148 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646565.9449377, 5abe25a8-40b0-45e4-8f4c-416b0445f5ca => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:25.945308 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] VM Resumed (Lifecycle Event)
May 13 04:29:26.045974 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:26.115236 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Took 16.90 seconds to build instance.
May 13 04:29:26.447690 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:26.449853 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:26.617803 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1976e32d-6e6b-465e-9667-13eaae77e56f tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.407s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:27.084043 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:27.084309 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 04:29:27.586157 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:28.152184 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:28.154342 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing instance network info cache due to event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:28.154342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] Acquiring lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:28.154342 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] Acquired lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:28.154342 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing network info cache for port 3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:28.659364 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:28.978100 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:29.098573 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updated VIF entry in instance network info cache for port 3e797080-fa84-4df7-b5f5-51ed3db3eab8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:29:29.098881 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:29.359428 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004438739997567609 future=<Future at 0x7a4648576c30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:29:29.362173 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] Emitting event <LifecycleEvent: 1778646554.3587768, e7a51a0e-6750-4d15-8071-3505dcfb2101 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:29.362173 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] VM Stopped (Lifecycle Event)
May 13 04:29:29.362173 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:29:29.600876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8ee5372c-0214-4c8d-96f1-8a9af278c015 req-aadc60a9-4cb1-4bc3-8713-9c98fabebe17 service nova] Releasing lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:29.864930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e749c6f3-bd25-47fb-ba30-1383df4a1886 tempest-TestStampPattern-2044631915 tempest-TestStampPattern-2044631915-project-member] [instance: e7a51a0e-6750-4d15-8071-3505dcfb2101] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:30.385452 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:30.580838 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:30.581101 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:31.047595 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:31.083669 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:31.083971 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:32.085393 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:32.085393 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:32.085866 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:32.590683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:32.590683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:32.590907 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:32.590907 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:29:33.626969 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:29:33.628696 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-12 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:29:33.630073 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:29:33.631368 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:29:33.632745 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:29:33.633945 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:33.727589 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:33.728131 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:33.822349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:33.824909 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:29:33.826035 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:33.874908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:33.875284 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=12275MB free_disk=72.73080825805664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:29:33.875443 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:33.875712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:34.942987 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 23f383b0-ad1a-4cb1-8afb-d792e9488982 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.943306 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 0007dd3e-b366-4789-84a8-6b7983f4375e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.943417 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance eb39b253-78ff-4768-aec4-cde1a39f1217 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.943532 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.943657 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 3a75a13d-02b8-40d7-8a54-ab864a097576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.943771 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 5abe25a8-40b0-45e4-8f4c-416b0445f5ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:29:34.944048 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:29:34.944231 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:29:33 up 43 min,  2 users,  load average: 4.00, 5.46, 5.02\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '6', 'num_proj_12dc09d5d69246b19f02313d2f4596e0': '3', 'io_workload': '0', 'num_proj_740f7c9f5d174dbab93ae09d1cad017d': '2', 'num_proj_2beee2d64aaf4c20b3d265917ef6d0cb': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:29:35.242694 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:29:35.242694 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:29:35.386526 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:35.745244 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:29:36.049442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:36.169462 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:36.169677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:36.251243 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:29:36.251403 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.376s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:36.251567 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:36.251677 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 04:29:36.671481 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:29:36.753508 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] There are 0 instances to clean {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 04:29:36.756602 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:37.224564 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:37.224991 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:37.228383 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:29:37.228547 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Claim successful on node np0000000669
May 13 04:29:37.259768 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:38.258345 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:38.258345 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:38.258345 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:38.258345 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:29:38.258345 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.82 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:38.566038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:29:38.566038 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:29:39.070412 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:29:39.576373 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.350s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:39.576373 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:29:40.081286 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:29:40.081925 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:40.083010 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:29:40.083010 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:29:40.083010 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:40.083154 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:40.101185 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:29:40.148977 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb359d584a0b41398ca70e7e57fd589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7988aac1411045f0b97e046631509aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:29:40.388174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:40.443958 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:40.494432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:40.494432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:40.583005 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:29:40.588357 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Successfully created port: a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:29:40.975963 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Successfully updated port: a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:29:40.996266 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:41.029671 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-changed-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:41.030075 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Refreshing instance network info cache due to event network-changed-a8168b5f-6312-4b64-b2b1-66e301846a54. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:41.030232 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] Acquiring lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:41.030335 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] Acquired lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:41.030478 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Refreshing network info cache for port a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:41.061952 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:41.089025 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:29:41.478197 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:41.499023 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Ignoring supplied device name: /dev/vdb
May 13 04:29:41.532225 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:41.594177 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Booting with volume a1229429-7f69-4a2c-92a3-b8965178116e at /dev/vda
May 13 04:29:41.598348 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:41.631887 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:41.643004 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:29:41.667038 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:41.709491 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:29:41.709739 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:29:41.718619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:29:41.720317 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe41:92aa', 'fe80::fc16:3eff:fedd:6b81', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fedb:b925', 'fe80::4474:a5ff:fe48:e7d9', 'fe80::fc16:3eff:feca:f801', 'fe80::fc16:3eff:fea4:91b7'] 
May 13 04:29:41.720609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:29:41.720704 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:29:41.721032 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:41.721354 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updating existing volume attachment record: bb707866-159d-4454-9310-b266c3670086 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:29:41.738438 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:42.001525 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:42.241261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-02025867-52c7-45b9-9b3f-519aca2cf15f req-11a475e9-e834-4809-9882-a3966de28644 service nova] Releasing lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:42.242295 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquired lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:42.242295 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:29:42.801797 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:29:42.937109 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:43.049194 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updating instance_info_cache with network_info: [{"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:43.084261 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:43.084459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:43.084649 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Attaching volume 2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 to /dev/vdb
May 13 04:29:43.117444 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:43.128829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:29:43.150029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:43.191424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:29:43.192312 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:29:43.200471 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:29:43.201623 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe3d:1ad0', 'fe80::80e8:fbff:fe21:b40d', 'fe80::fc16:3eff:fe41:92aa', 'fe80::fc16:3eff:fedd:6b81', 'fe80::7478:88ff:fe67:9708', 'fe80::fc16:3eff:fedb:b925', 'fe80::4474:a5ff:fe48:e7d9', 'fe80::fc16:3eff:feca:f801', 'fe80::fc16:3eff:fea4:91b7'] 
May 13 04:29:43.201755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:29:43.201880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:29:43.202109 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:43.202338 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating existing volume attachment record: 74ea0fa4-c627-4eeb-8d52-a4441c5f7b68 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:29:43.553658 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Releasing lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:43.553939 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance network_info: |[{"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:29:43.747841 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:29:43.748154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:43.748281 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:43.748713 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:43.748889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:29:43.760104 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:43.760613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:43.760794 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:43.761447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:43.765027 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:43.765279 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:43.772985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:43.772985 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:43.780637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:43.780637 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:43.785015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1] added
May 13 04:29:43.785015 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:43.785015 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:43.785015 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:43.785015 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:43.785015 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:43.785015 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:43.785268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:43.785414 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:43.785579 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:43.791915 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1] added
May 13 04:29:43.791915 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:43.791915 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:43.791915 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:43.791915 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:43.791915 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:43.791915 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:43.792229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:43.792229 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:43.792379 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:43.812633 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:29:43.813763 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:29:43.813983 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Creating image(s)
May 13 04:29:43.814259 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Did not create local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 04:29:43.814440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Ensure instance console log exists: /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:29:43.814678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:43.814879 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:43.815046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:43.815594 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Start _get_guest_xml network_info=[{"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '893e850e-29a9-4a2d-8272-6c5106153d97', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'serial': 'a1229429-7f69-4a2c-92a3-b8965178116e'}, 'disk_bus': 'virtio', 'attachment_id': 'bb707866-159d-4454-9310-b266c3670086', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:29:43.818220 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:29:43.819272 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-800368727', uuid='893e850e-29a9-4a2d-8272-6c5106153d97'), owner=OwnerMeta(userid='cb359d584a0b41398ca70e7e57fd589f', username='tempest-TestEncryptedCinderVolumes-1387017513-project-member', projectid='7988aac1411045f0b97e046631509aac', projectname='tempest-TestEncryptedCinderVolumes-1387017513'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646583.818947) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:29:43.820297 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:29:43.820683 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:29:43.821654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:29:43.821826 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:29:43.822703 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:29:43.822976 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:29:43.823101 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:29:43.823214 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:29:43.823375 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:29:43.823457 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:29:43.823578 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:29:43.823761 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:29:43.823901 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:29:43.824056 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:29:43.824201 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:29:43.824385 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:29:43.833496 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:29:43.833743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:43.833838 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:44.786064 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:44.792819 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:44.798881 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:44.798881 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:44.806641 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:44.806641 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.812235 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.820525 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.830605 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.831012 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.841679 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.842060 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:44.883715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.40.100,3260]
May 13 04:29:44.883715 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.40.100,3260] successful.
May 13 04:29:44.883715 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.888481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.50.100,3260]
May 13 04:29:44.888481 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.50.100,3260] successful.
May 13 04:29:44.888481 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.895405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.901253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.912817 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.913153 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:44.913424 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:44.913492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:44.914592 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] HCTL ('17', '-', '-', 0) found on session 192 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:44.914738 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:44.921664 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:44.922178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:44.922178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:44.923307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] HCTL ('18', '-', '-', 0) found on session 193 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:44.923456 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:44.928266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching for a device in session 192 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:44.928266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:44.937133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Searching for a device in session 193 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:44.937282 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:45.400242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:45.762575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:29:46.062804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:46.781285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found WWN 33000000021d15035 for multipath device dm-15 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:29:46.781531 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:46.781825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '33000000021d15035', 'path': '/dev/dm-15', 'multipath_id': '33000000021d15035'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:46.781944 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021d15035', 'path': '/dev/dm-15', 'multipath_id': '33000000021d15035'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:29:46.782342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.948s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:46.782564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:29:46.784397 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:46.793277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:46.793876 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:46.794178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:46.794371 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:46.794646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:46.795284 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:46.805615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:46.805615 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:46.810430 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:29:46.810430 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:46.816785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e] added
May 13 04:29:46.816785 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:46.816785 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:46.816785 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:46.816785 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:46.816785 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:46.816785 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:46.817073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:46.817073 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:46.817172 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:46.820598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e] added
May 13 04:29:46.820598 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:29:46.820598 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:46.820598 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:46.820598 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:29:46.820598 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:29:46.820598 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:46.820850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:29:46.820976 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:29:46.821101 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:29:47.287437 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Attempting to attach volume 2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:29:47.288940 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:   <alias name="ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1"/>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-15"/>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:   <serial>2fd6cbe8-8d34-4a68-9a32-02e1251e16d1</serial>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]: </disk>
May 13 04:29:47.288940 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:29:47.817785 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:29:47.821541 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:47.828527 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:47.828527 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:29:47.835191 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:29:47.835191 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.841158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.847083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.858009 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.858389 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.865999 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.866477 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:47.905802 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.40.100,3260]
May 13 04:29:47.905802 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.40.100,3260] successful.
May 13 04:29:47.905802 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.917177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.50.100,3260]
May 13 04:29:47.917177 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.50.100,3260] successful.
May 13 04:29:47.917177 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.917461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.933300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.937778 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.938198 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:47.938458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:47.938458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:47.939597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('19', '-', '-', 0) found on session 194 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:47.939698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:47.953741 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 194 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:47.953901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.954839 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:47.955101 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:47.955378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:47.955668 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:29:47.956962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] HCTL ('20', '-', '-', 0) found on session 195 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:29:47.957105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:29:47.971526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Searching for a device in session 195 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:29:47.971526 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:29:48.794975 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:29:48.917810 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:48.917959 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:48.918038 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:48.918191 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No VIF found with MAC fa:16:3e:db:b9:25, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:29:49.809649 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Found WWN 3300000004967f5e2 for multipath device dm-16 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:29:49.810086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:49.810694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== connect_volume: return (5977ms) {'type': 'block', 'scsi_wwn': '3300000004967f5e2', 'path': '/dev/disk/by-id/os-brick+dev+dm-16', 'multipath_id': '3300000004967f5e2'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:49.810823 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004967f5e2', 'path': '/dev/disk/by-id/os-brick+dev+dm-16', 'multipath_id': '3300000004967f5e2'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:29:49.838498 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-16'}, 'status': 'reserved', 'instance': '893e850e-29a9-4a2d-8272-6c5106153d97', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'serial': 'a1229429-7f69-4a2c-92a3-b8965178116e'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:29:49.839051 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:29:49.839272 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:29:49.839430 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:29:49.852487 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:29:49.852487 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:29:49.852487 np0000000669 nova-compute[97951]:     <volume>a1229429-7f69-4a2c-92a3-b8965178116e</volume>
May 13 04:29:49.852487 np0000000669 nova-compute[97951]:   </usage>
May 13 04:29:49.852487 np0000000669 nova-compute[97951]: </secret>
May 13 04:29:49.852487 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:29:50.361835 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-800368727',display_name='tempest-TestEncryptedCinderVolumes-server-800368727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-800368727',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-6okane90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:41Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=893e850e-29a9-4a2d-8272-6c5106153d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:29:50.362066 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:50.362782 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:50.363613 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'pci_devices' on Instance uuid 893e850e-29a9-4a2d-8272-6c5106153d97 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:50.415403 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.459251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-127e8f8b-d4a5-467e-ab81-db65eb18aa38 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.375s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:50.866543 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] End _get_guest_xml xml=<domain type="qemu">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <uuid>893e850e-29a9-4a2d-8272-6c5106153d97</uuid>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <name>instance-0000004b</name>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-800368727</nova:name>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:29:43</nova:creationTime>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:image uuid="">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:user uuid="cb359d584a0b41398ca70e7e57fd589f">tempest-TestEncryptedCinderVolumes-1387017513-project-member</nova:user>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:project uuid="7988aac1411045f0b97e046631509aac">tempest-TestEncryptedCinderVolumes-1387017513</nova:project>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:root type="volume" uuid=""/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <nova:port uuid="a8168b5f-6312-4b64-b2b1-66e301846a54">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <system>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="serial">893e850e-29a9-4a2d-8272-6c5106153d97</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="uuid">893e850e-29a9-4a2d-8272-6c5106153d97</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </system>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <os>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </os>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <features>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </features>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   <devices>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/disk.config"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <alias name="ua-a1229429-7f69-4a2c-92a3-b8965178116e"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-16"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <serial>a1229429-7f69-4a2c-92a3-b8965178116e</serial>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <encryption format="luks">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:         <secret type="passphrase" uuid="f5ce0ac3-05fc-4da3-afcc-8f620a4952fb"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       </encryption>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </disk>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:d6:1a:97"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <target dev="tapa8168b5f-63"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </interface>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/console.log" append="off"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </serial>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <video>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </video>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </rng>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:   </devices>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]: </domain>
May 13 04:29:50.866543 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Preparing to wait for external event network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-800368727',display_name='tempest-TestEncryptedCinderVolumes-server-800368727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-800368727',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-6okane90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:29:41Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=893e850e-29a9-4a2d-8272-6c5106153d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:29:50.868949 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:29:50.870076 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:29:50.871598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.871835 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:50.872059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:29:50.872874 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.873010 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bc96b3d-24e0-5a89-be8f-ed22c97e8a84', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:50.873799 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.874391 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:50.874933 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.877823 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.877940 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8168b5f-63, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:50.878223 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8168b5f-63, col_values=(('qos', UUID('45f10cf4-0de2-4731-b29f-535fba706c6b')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:50.878409 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8168b5f-63, col_values=(('external_ids', {'iface-id': 'a8168b5f-6312-4b64-b2b1-66e301846a54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:1a:97', 'vm-uuid': '893e850e-29a9-4a2d-8272-6c5106153d97'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:29:50.879079 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.880651 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:29:50.884675 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:50.885447 np0000000669 nova-compute[97951]: INFO os_vif [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63')
May 13 04:29:52.399899 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:52.400395 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:29:52.400395 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] No VIF found with MAC fa:16:3e:d6:1a:97, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:29:52.400668 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Using config drive
May 13 04:29:52.905815 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:53.018048 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Creating config drive at /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/disk.config
May 13 04:29:53.021042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8q_35i40 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:29:53.073154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8q_35i40" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:29:53.530297 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.533692 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.552158 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.651522 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.732283 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1b934cc2-d0e3-4a86-b66f-f52987cc0bf3 req-6b5ecde4-115d-44b3-b0fe-d1d6b5c7a212 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:53.732579 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b934cc2-d0e3-4a86-b66f-f52987cc0bf3 req-6b5ecde4-115d-44b3-b0fe-d1d6b5c7a212 service nova] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:53.732779 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b934cc2-d0e3-4a86-b66f-f52987cc0bf3 req-6b5ecde4-115d-44b3-b0fe-d1d6b5c7a212 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:53.732962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1b934cc2-d0e3-4a86-b66f-f52987cc0bf3 req-6b5ecde4-115d-44b3-b0fe-d1d6b5c7a212 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:53.733157 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1b934cc2-d0e3-4a86-b66f-f52987cc0bf3 req-6b5ecde4-115d-44b3-b0fe-d1d6b5c7a212 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Processing event network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:29:53.840245 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.841936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.845863 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.846985 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:53.865400 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:55.285525 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:29:55.286188 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646595.2857125, 893e850e-29a9-4a2d-8272-6c5106153d97 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:55.286549 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] VM Started (Lifecycle Event)
May 13 04:29:55.291371 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:29:55.295791 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance spawned successfully.
May 13 04:29:55.296391 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:29:55.417216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:55.784792 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:55.785042 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:55.785240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:55.785393 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:55.785465 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] No waiting events found dispatching network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:29:55.785861 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7841c58c-f660-4bf0-8040-aea3991b0818 req-331a79db-c01a-44de-b5cb-860a445a93c8 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received unexpected event network-vif-plugged-a8168b5f-6312-4b64-b2b1-66e301846a54 for instance with vm_state building and task_state spawning.
May 13 04:29:55.790280 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:55.794612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:55.803106 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.803169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.803480 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.803613 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.803823 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.804055 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:29:55.880947 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:29:56.296647 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:29:56.297150 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646596.2967367, 893e850e-29a9-4a2d-8272-6c5106153d97 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:56.297150 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] VM Paused (Lifecycle Event)
May 13 04:29:56.308429 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Took 12.50 seconds to spawn the instance on the hypervisor.
May 13 04:29:56.308662 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:56.341968 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:56.342141 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:56.407577 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:56.799234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:56.805642 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646596.8054142, 893e850e-29a9-4a2d-8272-6c5106153d97 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:29:56.805739 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] VM Resumed (Lifecycle Event)
May 13 04:29:56.816220 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Took 19.64 seconds to build instance.
May 13 04:29:56.844636 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Detaching volume 2fd6cbe8-8d34-4a68-9a32-02e1251e16d1
May 13 04:29:56.885796 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Attempting to driver detach volume 2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 from mountpoint /dev/vdb
May 13 04:29:56.889865 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found disk vdb by alias ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:29:56.890881 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Found disk vdb by alias ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:29:56.891032 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Attempting to detach device vdb from instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:29:56.891287 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <alias name="ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1"/>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-15"/>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <serial>2fd6cbe8-8d34-4a68-9a32-02e1251e16d1</serial>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]: </disk>
May 13 04:29:56.891287 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:29:56.903451 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully detached device vdb from instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 from the persistent domain config.
May 13 04:29:56.903645 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] (1/8): Attempting to detach device vdb with device alias ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 from instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:29:56.903872 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <alias name="ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1"/>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-15"/>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <serial>2fd6cbe8-8d34-4a68-9a32-02e1251e16d1</serial>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]: </disk>
May 13 04:29:56.903872 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:29:57.307733 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:29:57.311469 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:29:57.318248 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.148s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:57.518094 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 for instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:29:57.707379 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-changed-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:29:57.707642 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Refreshing instance network info cache due to event network-changed-a8168b5f-6312-4b64-b2b1-66e301846a54. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:29:57.707732 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] Acquiring lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:29:57.707763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] Acquired lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:29:57.707888 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Refreshing network info cache for port a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:29:57.813675 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646597.8133745, 479a32b6-b0ed-45ec-9456-d3f90ee619c6 => ua-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:29:57.816451 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully detached device vdb from instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 from the live domain config.
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:29:57.818901 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1 (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:29:57.856287 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', '192')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:29:57.856287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', '193')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:29:57.857125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c74b060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'): ({'sdm'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:29:57.857125 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Removing multipathed devices sdm, sdl {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:29:57.857260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Flush multipath device 33000000021d15035 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:29:57.882835 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:29:57.928798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:29:57.967743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:29:57.967944 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:29:57.969872 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:29:57.981345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:29:57.981345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:29:57.989508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.029257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.40.100,3260]
May 13 04:29:58.029257 np0000000669 nova-compute[97951]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.40.100,3260] successful.
May 13 04:29:58.029257 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.051401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.062837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.095797 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.50.100,3260]
May 13 04:29:58.095797 np0000000669 nova-compute[97951]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, portal: 192.168.50.100,3260] successful.
May 13 04:29:58.095797 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.118004 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:29:58.118168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:29:58.118283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== disconnect_volume: return (300ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:29:58.118416 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:29:58.209765 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:58.500698 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:29:58.618755 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updated VIF entry in instance network info cache for port a8168b5f-6312-4b64-b2b1-66e301846a54. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:29:58.619104 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updating instance_info_cache with network_info: [{"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:29:58.658787 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'flavor' on Instance uuid 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:29:59.121175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-04f27a6c-1b37-40e0-9347-f18960144f24 req-6515d3cd-a516-494b-8952-575983efc9de service nova] Releasing lock "refresh_cache-893e850e-29a9-4a2d-8272-6c5106153d97" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:29:59.663980 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-12632e31-f735-4a87-93ce-4882a3df629a tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.322s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:59.665716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.257s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:59.666599 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:29:59.666854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:29:59.667147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:29:59.669299 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Terminating instance
May 13 04:30:00.179290 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:00.203172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.207524 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.224189 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.226279 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.240587 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.246600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.386093 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:00.386285 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:00.386450 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:00.386840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:00.386963 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] No waiting events found dispatching network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:00.387080 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1fcc1608-d8fd-4b78-93b6-82b5b00c9b88 req-6cac2af9-508e-4a18-b5b5-67afa597de02 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:00.418937 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:00.506974 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99973610699999 future=<Future at 0x7a4648109820 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:00.507782 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99905786499994 future=<Future at 0x7a4648109820 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:00.507782 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99891277000006 future=<Future at 0x7a4648109820 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:00.511992 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Instance destroyed successfully.
May 13 04:30:00.512434 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lazy-loading 'resources' on Instance uuid 479a32b6-b0ed-45ec-9456-d3f90ee619c6 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:00.615186 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:00.615362 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:00.615501 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:00.615615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:00.615719 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:00.620258 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Terminating instance
May 13 04:30:00.881511 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.015088 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1822191914',display_name='tempest-VolumesSnapshotTestJSON-instance-1822191914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumessnapshottestjson-instance-1822191914',id=72,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgCz1hFdvmpggXEBFrUMIUh4BWDYP4P2hgZaFpLDaKWv8G9Y6XHUg5k3TbQyMOTN7SSplyBE4KyLq15lBJj6ZCHYwk40+7q+un2cUiLgwlDyDliky3cLN78jhGhlbIo4g==',key_name='tempest-keypair-591965143',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:29:02Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2beee2d64aaf4c20b3d265917ef6d0cb',ramdisk_id='',reservation_id='r-an7e3oql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-85989347',owner_user_name='tempest-VolumesSnapshotTestJSON-85989347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4afc202e8f442f880bee837107aa232',uuid=479a32b6-b0ed-45ec-9456-d3f90ee619c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:01.015317 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converting VIF {"id": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "address": "fa:16:3e:db:b9:25", "network": {"id": "08d9d788-ed4a-4b07-b39c-c05c5feaef5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2119113438-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2beee2d64aaf4c20b3d265917ef6d0cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00e014d3-21", "ovs_interfaceid": "00e014d3-2162-4f07-9f80-d9d9ddbc2253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:01.016118 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:01.016460 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:01.018100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.018367 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00e014d3-21, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:01.021029 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.022170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:01.023011 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.023168 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7c0f5a6-8d09-4c8a-80c0-355d6a96dfd2) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:01.025384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:01.027213 np0000000669 nova-compute[97951]: INFO os_vif [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:25,bridge_name='br-int',has_traffic_filtering=True,id=00e014d3-2162-4f07-9f80-d9d9ddbc2253,network=Network(08d9d788-ed4a-4b07-b39c-c05c5feaef5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00e014d3-21')
May 13 04:30:01.028750 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:01.029105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:01.029283 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:01.029725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:01.030113 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:01.030295 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:01.057498 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:01.057934 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:01.057934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:01.058244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:01.058244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:30:01.058306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1, 0): [] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:01.058702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fd6cbe8-8d34-4a68-9a32-02e1251e16d1') {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 04:30:01.058702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c71ae80>, {}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:01.058899 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Disconnecting from: [] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:01.058998 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:01.059149 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] <== disconnect_volume: return (29ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:01.059314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:01.059661 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Deleting instance files /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6_del
May 13 04:30:01.060671 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Deletion of /opt/stack/data/nova/instances/479a32b6-b0ed-45ec-9456-d3f90ee619c6_del complete
May 13 04:30:01.123054 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:01.138243 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.159608 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.285784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:01.286032 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:01.286211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:01.286382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:01.286523 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] No waiting events found dispatching network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:01.286659 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cab3b8e6-06de-467f-a773-7b13e51460d5 req-8b0efd7d-c422-44a4-886b-7158a9de7ff8 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:01.287635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.290513 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.463826 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999616298000092 future=<Future at 0x7a461c755430 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:01.467314 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Instance destroyed successfully.
May 13 04:30:01.467775 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'resources' on Instance uuid 3a75a13d-02b8-40d7-8a54-ab864a097576 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:01.569123 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 04:30:01.570065 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:01.570065 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:01.570065 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:01.570294 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:01.707371 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:01.970396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-217634504',display_name='tempest-TestVolumeBootPatternV346-server-217634504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-217634504',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5GvA9OXRE4lSFX93DOssmcBZnr1brpf069F6NTYSZLcO1Gv7MsDobXwyAT+blVxhUQ67fvE44WOKxcByXq5hJlnoktfujpx6PYU5Hbd5PPc722mTXFAn3SXR0fiWbeog==',key_name='tempest-keypair-25255921',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:29:22Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-si7uj032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=3a75a13d-02b8-40d7-8a54-ab864a097576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:01.973181 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "28d4c797-9772-475f-9927-5f722698ef9d", "address": "fa:16:3e:ca:f8:01", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d4c797-97", "ovs_interfaceid": "28d4c797-9772-475f-9927-5f722698ef9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:01.973181 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:01.973181 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:01.974811 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.975117 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28d4c797-97, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:01.979925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.980964 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:01.981901 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.982068 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d32bff8-17fa-401b-a8c4-0c33b04b02c8) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:01.982638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.983140 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:01.984563 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:01.988729 np0000000669 nova-compute[97951]: INFO os_vif [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=28d4c797-9772-475f-9927-5f722698ef9d,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d4c797-97')
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc7200-a2eb-462f-a3b6-2650c55ee397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:01.991076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:02.031940 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '187')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:02.031940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397', '186')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:02.034587 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c749f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'): ({'sdh'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:02.035017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Removing multipathed devices sdh, sdi {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:02.035404 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flush multipath device 33000000038a52d6d {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:02.103606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:02.153951 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:02.202727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:02.202727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:02.202727 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:02.214581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:02.214581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:02.226643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.264357 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.40.100,3260]
May 13 04:30:02.264357 np0000000669 nova-compute[97951]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.40.100,3260] successful.
May 13 04:30:02.264357 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.290367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.303695 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.342646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.50.100,3260]
May 13 04:30:02.342646 np0000000669 nova-compute[97951]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-b1fc7200-a2eb-462f-a3b6-2650c55ee397, portal: 192.168.50.100,3260] successful.
May 13 04:30:02.342646 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.361765 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:02.365356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:02.365356 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== disconnect_volume: return (371ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:02.365356 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:02.365356 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Deleting instance files /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576_del
May 13 04:30:02.365356 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Deletion of /opt/stack/data/nova/instances/3a75a13d-02b8-40d7-8a54-ab864a097576_del complete
May 13 04:30:02.467109 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:02.467288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] Acquiring lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:02.467466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:02.467582 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:02.467691 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] No waiting events found dispatching network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:02.467799 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-unplugged-00e014d3-2162-4f07-9f80-d9d9ddbc2253 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:02.467905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Received event network-vif-deleted-00e014d3-2162-4f07-9f80-d9d9ddbc2253 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:02.468012 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Neutron deleted interface 00e014d3-2162-4f07-9f80-d9d9ddbc2253; detaching it from the instance and deleting it from the info cache
May 13 04:30:02.468119 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:02.614279 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:02.870714 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Took 1.75 seconds to destroy the instance on the hypervisor.
May 13 04:30:02.871122 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:02.871387 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:02.871387 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:02.871645 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:02.924018 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:02.972133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-85073d7b-41e6-407a-927a-d7159c649c9f req-19069025-05e1-48e9-b785-f088840984b9 service nova] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Detach interface failed, port_id=00e014d3-2162-4f07-9f80-d9d9ddbc2253, reason: Instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:30:03.116492 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Took 1.55 seconds to deallocate network for instance.
May 13 04:30:03.146815 np0000000669 nova-compute[97951]: WARNING nova.volume.cinder [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Attachment 74ea0fa4-c627-4eeb-8d52-a4441c5f7b68 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74ea0fa4-c627-4eeb-8d52-a4441c5f7b68. (HTTP 404) (Request-ID: req-8d1287ec-0f17-4bc5-bdc7-afbab1fe19cd)
May 13 04:30:03.147089 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Took 0.03 seconds to detach 1 volumes for instance.
May 13 04:30:03.350462 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:03.350633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] Acquiring lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:03.350777 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:03.350899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:03.351028 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] No waiting events found dispatching network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:03.351139 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-cc77f4ac-f99a-407c-8e0e-6dffec02fc36 req-1de05701-39ef-4fce-b748-998f5c6eb603 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-unplugged-28d4c797-9772-475f-9927-5f722698ef9d for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:03.656347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:03.656520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:03.729702 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Refreshing inventories for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 04:30:03.769135 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Updating ProviderTree inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 04:30:03.769341 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:30:03.809710 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Refreshing aggregate associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, aggregates: None {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 04:30:03.811813 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:03.867207 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Refreshing trait associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_ICH9,HW_ARCH_X86_64,HW_CPU_X86_SSE,COMPUTE_ARCH_X86_64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ARCH_PPC64LE,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 04:30:04.204456 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:04.204968 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:04.315609 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Took 1.44 seconds to deallocate network for instance.
May 13 04:30:04.707991 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:04.866510 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:30:05.213938 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.557s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:05.255542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:05.255716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:05.255902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:05.256024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:05.256151 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:05.260226 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Terminating instance
May 13 04:30:05.266236 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Deleted allocations for instance 479a32b6-b0ed-45ec-9456-d3f90ee619c6
May 13 04:30:05.371384 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:05.371703 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:05.424041 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Received event network-vif-deleted-28d4c797-9772-475f-9927-5f722698ef9d {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:05.424181 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:05.424302 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing instance network info cache due to event network-changed-3e797080-fa84-4df7-b5f5-51ed3db3eab8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:30:05.424455 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] Acquiring lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:30:05.424534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] Acquired lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:30:05.424631 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Refreshing network info cache for port 3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:30:05.435390 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.683586 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:05.683586 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:05.763465 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:05.780115 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.783599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.799540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.910544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.916265 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:05.928945 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:06.112846 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999701162999827 future=<Future at 0x7a461c6fe7e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:06.117061 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Instance destroyed successfully.
May 13 04:30:06.117061 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid 5abe25a8-40b0-45e4-8f4c-416b0445f5ca {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:06.187341 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:06.260191 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:06.276051 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-8b6d5843-f7e1-47be-b6e9-e05f2c8276d9 tempest-VolumesSnapshotTestJSON-85989347 tempest-VolumesSnapshotTestJSON-85989347-project-member] Lock "479a32b6-b0ed-45ec-9456-d3f90ee619c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.612s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:06.377394 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updated VIF entry in instance network info cache for port 3e797080-fa84-4df7-b5f5-51ed3db3eab8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:30:06.377737 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [{"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:06.620897 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-610812140',display_name='tempest-TestVolumeBootPattern-server-610812140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-610812140',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:29:25Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-9dwfzjfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:29:26Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=5abe25a8-40b0-45e4-8f4c-416b0445f5ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:06.621093 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "address": "fa:16:3e:a4:91:b7", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e797080-fa", "ovs_interfaceid": "3e797080-fa84-4df7-b5f5-51ed3db3eab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:06.621806 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:06.622088 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:06.623148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:06.623419 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e797080-fa, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:06.624407 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:06.625443 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:06.626137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:06.626271 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f70a1230-e55c-47ac-8ad9-edcafee59785) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:06.626667 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:06.627189 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:06.627521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:06.629920 np0000000669 nova-compute[97951]: INFO os_vif [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:91:b7,bridge_name='br-int',has_traffic_filtering=True,id=3e797080-fa84-4df7-b5f5-51ed3db3eab8,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e797080-fa')
May 13 04:30:06.631465 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:06.631820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:06.631967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:06.632278 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:06.632587 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:06.632755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:06.660391 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7 (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:06.660785 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:06.660785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '189')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:06.661666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7', '188')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:06.662467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c2ea840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'): ({'sdj'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:06.662585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdj, sdk {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:06.662790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 33000000059d61575 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:06.695347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.321s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:06.723665 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:06.748787 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Deleted allocations for instance 3a75a13d-02b8-40d7-8a54-ab864a097576
May 13 04:30:06.787090 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:06.841042 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:06.841273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:06.843922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:06.854969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:06.855167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:06.865750 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.881737 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-3de8413e-5406-4d5b-bc59-618b9a371976 req-daabbb41-52ac-44cc-aaac-ee786d4c69b7 service nova] Releasing lock "refresh_cache-5abe25a8-40b0-45e4-8f4c-416b0445f5ca" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:30:06.901450 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.40.100,3260]
May 13 04:30:06.901450 np0000000669 nova-compute[97951]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.40.100,3260] successful.
May 13 04:30:06.901450 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.923609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.935467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.967250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.50.100,3260]
May 13 04:30:06.967250 np0000000669 nova-compute[97951]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-6f58afb0-4eba-49f0-8e35-da7e67cdb9d7, portal: 192.168.50.100,3260] successful.
May 13 04:30:06.967250 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.989057 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:06.989253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:06.989358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (357ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:06.989484 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:06.989789 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Deleting instance files /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca_del
May 13 04:30:06.990237 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Deletion of /opt/stack/data/nova/instances/5abe25a8-40b0-45e4-8f4c-416b0445f5ca_del complete
May 13 04:30:07.493054 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:07.494494 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:07.494951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:07.495190 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:07.495263 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] No waiting events found dispatching network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:07.495395 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:07.495520 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:07.495680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Acquiring lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:07.495902 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:07.496003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:07.496111 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] No waiting events found dispatching network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:07.496241 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f9bcbc9f-8a3f-49b9-bf17-7647e65974ad req-8ec4a7a8-beb1-4a89-b4f3-d4bc92e60cf0 service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-unplugged-3e797080-fa84-4df7-b5f5-51ed3db3eab8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:07.497826 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Took 1.73 seconds to destroy the instance on the hypervisor.
May 13 04:30:07.498372 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:07.498696 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:07.499404 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:07.499404 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:07.564771 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:07.759683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7448c94f-a191-4d86-a3bd-0e4428e2fcac tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "3a75a13d-02b8-40d7-8a54-ab864a097576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.144s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:07.813547 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86e4d87b-51e1-4aca-9ecb-04934f187b78 req-ff1859aa-7d08-497d-8a45-066042668abf service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Received event network-vif-deleted-3e797080-fa84-4df7-b5f5-51ed3db3eab8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:07.813919 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-86e4d87b-51e1-4aca-9ecb-04934f187b78 req-ff1859aa-7d08-497d-8a45-066042668abf service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Neutron deleted interface 3e797080-fa84-4df7-b5f5-51ed3db3eab8; detaching it from the instance and deleting it from the info cache
May 13 04:30:07.814033 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-86e4d87b-51e1-4aca-9ecb-04934f187b78 req-ff1859aa-7d08-497d-8a45-066042668abf service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:08.269348 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:08.318522 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86e4d87b-51e1-4aca-9ecb-04934f187b78 req-ff1859aa-7d08-497d-8a45-066042668abf service nova] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Detach interface failed, port_id=3e797080-fa84-4df7-b5f5-51ed3db3eab8, reason: Instance 5abe25a8-40b0-45e4-8f4c-416b0445f5ca could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:30:08.770370 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Took 1.27 seconds to deallocate network for instance.
May 13 04:30:09.313547 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Took 0.54 seconds to detach 1 volumes for instance.
May 13 04:30:09.817632 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:09.818086 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:10.050547 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:10.050735 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:10.443404 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:10.553115 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:11.062435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.244s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:11.113040 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance 5abe25a8-40b0-45e4-8f4c-416b0445f5ca
May 13 04:30:11.536099 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:11.536265 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:11.536464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:11.536629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:11.536736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:11.538759 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Terminating instance
May 13 04:30:11.648477 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.042108 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:12.056719 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.058264 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.071873 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.122790 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d08c30af-b2fd-4e36-b264-b948cbeb2aef tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "5abe25a8-40b0-45e4-8f4c-416b0445f5ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.867s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:12.165640 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.170294 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.190698 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:12.190820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:12.191021 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:12.191452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:12.191632 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] No waiting events found dispatching network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:12.191779 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6a18ee81-20b3-46ea-9c02-635e50f041d1 req-92e606dd-4c0e-4ebc-8407-7920665302e3 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:12.349475 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999761643000056 future=<Future at 0x7a4648536f60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:12.351879 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Instance destroyed successfully.
May 13 04:30:12.352303 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'resources' on Instance uuid 0007dd3e-b366-4789-84a8-6b7983f4375e {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:12.855559 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-459721723',display_name='tempest-TestVolumeBootPatternV346-server-459721723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-459721723',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMw4l1YCBeN2oY/HKx8oqZwOV4CsBrAVNbqmuQoJiQUOypM7lZzb4Wbx2orJhSpA1tmnDZXzoZqMwhyPtdvkL4DDDRCh6Yn3k6WzWWtvaYF2edAI5L3+bcRq0Y6w3vt1Q==',key_name='tempest-keypair-1172956807',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:28:21Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-0d18jfwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=0007dd3e-b366-4789-84a8-6b7983f4375e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:12.855806 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "address": "fa:16:3e:41:92:aa", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4407a5c3-0f", "ovs_interfaceid": "4407a5c3-0f6e-4fdd-9519-586f16960f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:12.856429 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:12.856728 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:12.857632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.857784 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4407a5c3-0f, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:12.874970 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.876612 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:12.877627 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.877816 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8d65a41-30c7-4f82-9df8-a75872533054) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:12.878351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.879250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:12.879250 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:12.881391 np0000000669 nova-compute[97951]: INFO os_vif [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:92:aa,bridge_name='br-int',has_traffic_filtering=True,id=4407a5c3-0f6e-4fdd-9519-586f16960f47,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4407a5c3-0f')
May 13 04:30:12.883042 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:12.883397 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:12.883586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:12.884026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:12.884390 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f49571f9-c72f-4b3f-a98d-c205639d4726', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:12.885371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:12.914388 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:12.914888 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:12.914888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:12.915141 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '179')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:12.916189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726', '178')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:12.917266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c6ff600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'): ({'sdb'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:12.917512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Removing multipathed devices sdb, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:12.917787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flush multipath device 330000000eb16df3a {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:12.975787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:13.022881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:13.060063 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if SCSI volumes sdb, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:13.060063 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] SCSI volumes sdb, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:13.061576 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if device paths {'sdb', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:13.072366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Device paths {'sdb', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:13.072815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:13.084034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.117517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.40.100,3260]
May 13 04:30:13.117517 np0000000669 nova-compute[97951]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.40.100,3260] successful.
May 13 04:30:13.117517 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.133242 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.145161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.175422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.50.100,3260]
May 13 04:30:13.175422 np0000000669 nova-compute[97951]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-f49571f9-c72f-4b3f-a98d-c205639d4726, portal: 192.168.50.100,3260] successful.
May 13 04:30:13.175422 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.191572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:13.192009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:13.192218 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== disconnect_volume: return (308ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:13.192404 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:13.192761 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Deleting instance files /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e_del
May 13 04:30:13.193517 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Deletion of /opt/stack/data/nova/instances/0007dd3e-b366-4789-84a8-6b7983f4375e_del complete
May 13 04:30:13.700000 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Took 1.66 seconds to destroy the instance on the hypervisor.
May 13 04:30:13.700651 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:13.700967 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:13.701089 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:13.701359 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:13.756305 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:14.136228 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6d838261-a0e5-4105-80d5-fd8b8be5c1c5 req-bc995046-951f-46d1-9e34-bdcc507d7fb0 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-deleted-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:14.136228 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-6d838261-a0e5-4105-80d5-fd8b8be5c1c5 req-bc995046-951f-46d1-9e34-bdcc507d7fb0 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Neutron deleted interface 4407a5c3-0f6e-4fdd-9519-586f16960f47; detaching it from the instance and deleting it from the info cache
May 13 04:30:14.136773 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-6d838261-a0e5-4105-80d5-fd8b8be5c1c5 req-bc995046-951f-46d1-9e34-bdcc507d7fb0 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:14.250394 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:14.250793 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] Acquiring lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:14.251439 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:14.251614 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:14.251752 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] No waiting events found dispatching network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:14.251987 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f6dd6809-37dc-48a5-a051-d288badf9929 req-bc7aef37-6bc7-459f-aa67-9cc1360428da service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Received event network-vif-unplugged-4407a5c3-0f6e-4fdd-9519-586f16960f47 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:14.589360 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:14.639548 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6d838261-a0e5-4105-80d5-fd8b8be5c1c5 req-bc995046-951f-46d1-9e34-bdcc507d7fb0 service nova] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Detach interface failed, port_id=4407a5c3-0f6e-4fdd-9519-586f16960f47, reason: Instance 0007dd3e-b366-4789-84a8-6b7983f4375e could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:30:14.777286 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:14.777483 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:14.777627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:14.777747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:14.777871 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:14.779922 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Terminating instance
May 13 04:30:15.090627 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Took 1.39 seconds to deallocate network for instance.
May 13 04:30:15.282488 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:15.309317 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.311188 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.326521 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.339996 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.344251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.437843 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:15.438240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:15.438399 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:15.438532 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:15.438646 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] No waiting events found dispatching network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:15.438763 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2b2647bc-34c3-47e9-abab-a34acae44672 req-a2df1d76-948a-43df-8b16-c11d7ffa7c06 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:15.444083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:15.507229 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0005209790001572401 future=<Future at 0x7a4648109820 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:15.508033 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] Emitting event <LifecycleEvent: 1778646600.5066125, 479a32b6-b0ed-45ec-9456-d3f90ee619c6 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:15.508197 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:15.508451 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] VM Stopped (Lifecycle Event)
May 13 04:30:15.509224 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.9541883270003382 future=<Future at 0x7a461c755430 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:15.509386 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=0.9540175940001063 future=<Future at 0x7a461c755430 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:15.586446 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999680003999856 future=<Future at 0x7a463c19dd60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:15.587864 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Instance destroyed successfully.
May 13 04:30:15.588334 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lazy-loading 'resources' on Instance uuid eb39b253-78ff-4768-aec4-cde1a39f1217 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:15.635278 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Took 0.54 seconds to detach 1 volumes for instance.
May 13 04:30:16.011336 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-9b16c3ad-dc2a-4116-828e-21f5e5e12125 tempest-ImageDependencyTests-936758513 tempest-ImageDependencyTests-936758513-project-member] [instance: 479a32b6-b0ed-45ec-9456-d3f90ee619c6] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:16.091122 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:28:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1487281873',display_name='tempest-TestVolumeBootPattern-server-1487281873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpattern-server-1487281873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/SbMo0yCGIrkggRRUiffPNVY7LUiucKDUZLzP70UYgCzb6kew3WVY2g82CpEtSaOHcW0FckzzyZkewQ+DE2Yk0xsZ4gqI8d26y0tPNWQEH6e4xmY/WB/PM3G+LlA842A==',key_name='tempest-TestVolumeBootPattern-1488601422',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:28:24Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740f7c9f5d174dbab93ae09d1cad017d',ramdisk_id='',reservation_id='r-a3nl79ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-722735240',owner_user_name='tempest-TestVolumeBootPattern-722735240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:28:25Z,user_data=None,user_id='059a5dddf67c4a9a9a53c500c0b81a3c',uuid=eb39b253-78ff-4768-aec4-cde1a39f1217,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:16.091335 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converting VIF {"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:16.091886 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:16.092130 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:16.093046 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.093196 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dbd5d16-c0, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:16.094063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.094713 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:16.095253 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.095831 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.095934 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=253c8e43-4353-4804-ae04-f4fb3d454ffd) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:16.096597 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.096723 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:16.097097 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:16.098875 np0000000669 nova-compute[97951]: INFO os_vif [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6b:81,bridge_name='br-int',has_traffic_filtering=True,id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77,network=Network(d725dbad-5df3-4f60-81de-1bdbd7a62c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbd5d16-c0')
May 13 04:30:16.100272 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:16.100607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:16.100754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:16.101159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:16.101499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec2f50fb-f606-4902-a641-0c9a595d76f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:16.101659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:16.125746 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5 (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:16.125989 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:16.126099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:16.126263 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '180')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:16.127256 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5', '181')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:16.128129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648129620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:16.128335 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:16.128682 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Flush multipath device 330000000c37cdf2a {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:16.140121 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:16.140221 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:16.182440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:16.217937 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:16.266601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:16.266755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:16.267559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:16.279519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:16.279684 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:16.291775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.319466 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:16.319466 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing instance network info cache due to event network-changed-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:30:16.319466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] Acquiring lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:30:16.319560 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] Acquired lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:30:16.319715 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Refreshing network info cache for port 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:30:16.329493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260]
May 13 04:30:16.329493 np0000000669 nova-compute[97951]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.40.100,3260] successful.
May 13 04:30:16.329493 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.340667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:16.340878 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:16.344507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.355432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.384250 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260]
May 13 04:30:16.384250 np0000000669 nova-compute[97951]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-ec2f50fb-f606-4902-a641-0c9a595d76f5, portal: 192.168.50.100,3260] successful.
May 13 04:30:16.384250 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.397422 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:16.397658 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:16.397815 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] <== disconnect_volume: return (297ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:16.397959 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:16.398239 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Deleting instance files /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217_del
May 13 04:30:16.398845 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Deletion of /opt/stack/data/nova/instances/eb39b253-78ff-4768-aec4-cde1a39f1217_del complete
May 13 04:30:16.463889 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004246019998390693 future=<Future at 0x7a461c755430 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:16.464156 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:16.464463 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646601.4633439, 3a75a13d-02b8-40d7-8a54-ab864a097576 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:16.464659 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=4.647524549000082 future=<Future at 0x7a461c6fe7e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:16.464840 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] VM Stopped (Lifecycle Event)
May 13 04:30:16.465784 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=4.646413505000055 future=<Future at 0x7a461c6fe7e0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:16.821171 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:16.843167 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:16.905191 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Took 1.62 seconds to destroy the instance on the hypervisor.
May 13 04:30:16.905623 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:16.905809 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:16.905895 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:16.906127 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:16.967055 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 3a75a13d-02b8-40d7-8a54-ab864a097576] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:16.994194 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:17.097997 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:17.242646 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updated VIF entry in instance network info cache for port 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:30:17.242959 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [{"id": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "address": "fa:16:3e:dd:6b:81", "network": {"id": "d725dbad-5df3-4f60-81de-1bdbd7a62c53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-298605796-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "740f7c9f5d174dbab93ae09d1cad017d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbd5d16-c0", "ovs_interfaceid": "6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:17.259989 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4491d7d-b7b1-4a54-96b1-3e67c3519cb7 req-5849f447-36cb-49ae-9078-2ab702c4e668 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-deleted-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:17.260136 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-c4491d7d-b7b1-4a54-96b1-3e67c3519cb7 req-5849f447-36cb-49ae-9078-2ab702c4e668 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Neutron deleted interface 6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77; detaching it from the instance and deleting it from the info cache
May 13 04:30:17.260243 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c4491d7d-b7b1-4a54-96b1-3e67c3519cb7 req-5849f447-36cb-49ae-9078-2ab702c4e668 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:17.350142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.210s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:17.392144 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Deleted allocations for instance 0007dd3e-b366-4789-84a8-6b7983f4375e
May 13 04:30:17.501796 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:17.502039 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] Acquiring lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:17.502154 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:17.502316 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:17.502479 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] No waiting events found dispatching network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:17.502653 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b8022e07-ebf8-4d9a-bba2-de50b909d39b req-23785ea0-542c-4bbc-9c80-8ccd24e3d6ed service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Received event network-vif-unplugged-6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:17.711706 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:17.744882 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9d9b4197-74a7-4092-b08c-96ca7c658bcc req-cd77f51b-a311-40d4-aa6f-263b356383c1 service nova] Releasing lock "refresh_cache-eb39b253-78ff-4768-aec4-cde1a39f1217" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:30:17.764650 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4491d7d-b7b1-4a54-96b1-3e67c3519cb7 req-5849f447-36cb-49ae-9078-2ab702c4e668 service nova] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Detach interface failed, port_id=6dbd5d16-c0c7-4afc-a36a-b2d1fb906e77, reason: Instance eb39b253-78ff-4768-aec4-cde1a39f1217 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:30:18.213661 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Took 1.31 seconds to deallocate network for instance.
May 13 04:30:18.400086 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da00c15c-255a-4bf3-80fe-e1276f1553a6 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "0007dd3e-b366-4789-84a8-6b7983f4375e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.864s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:18.753777 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Took 0.54 seconds to detach 1 volumes for instance.
May 13 04:30:19.259111 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:19.259283 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:19.432590 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:19.432994 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:19.935000 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:20.440858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.181s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:20.446236 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:20.487628 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Deleted allocations for instance eb39b253-78ff-4768-aec4-cde1a39f1217
May 13 04:30:21.007441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:21.007576 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:21.007750 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:21.007899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:21.008036 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:21.010607 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Terminating instance
May 13 04:30:21.097476 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.112711 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003924080001524999 future=<Future at 0x7a461c6fe7e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:21.112888 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:21.112888 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.236330647999694 future=<Future at 0x7a4648536f60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:21.112958 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.23625988799995 future=<Future at 0x7a4648536f60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:21.113977 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Emitting event <LifecycleEvent: 1778646606.1121235, 5abe25a8-40b0-45e4-8f4c-416b0445f5ca => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:21.113977 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] VM Stopped (Lifecycle Event)
May 13 04:30:21.495142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-6d10baef-a45d-47c3-86a7-4be71ca6949d tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Lock "eb39b253-78ff-4768-aec4-cde1a39f1217" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.717s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:21.513463 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:21.543537 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.559495 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.578435 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.615728 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 5abe25a8-40b0-45e4-8f4c-416b0445f5ca] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:21.668495 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:21.668626 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:21.668774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:21.668873 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:21.668977 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] No waiting events found dispatching network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:21.669075 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-8643ad61-be9b-46b0-84ba-bfe5cb556666 req-7d060d48-5e38-4c28-a060-e9a9bfb44b35 service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:21.800497 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.806707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:21.826859 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999695783000334 future=<Future at 0x7a461c756180 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:21.828385 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Instance destroyed successfully.
May 13 04:30:21.829286 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lazy-loading 'resources' on Instance uuid 23f383b0-ad1a-4cb1-8afb-d792e9488982 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:22.333596 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2085134616',display_name='tempest-TestVolumeBootPatternV346-server-2085134616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testvolumebootpatternv346-server-2085134616',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaFmMqKwoEutGiMXhEuyO8Lm9sH7g6f5hvgIHimKe/64haMSMDi6oNLvmV4zL27BhyulTlENilGB9xKxyQ5TTKEK/f7HjIS54emKjXjYshSGzXhPEgnSQraUoDlGNbdzg==',key_name='tempest-keypair-1927074232',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:27:21Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12dc09d5d69246b19f02313d2f4596e0',ramdisk_id='',reservation_id='r-lcdl8olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1311400665',owner_user_name='tempest-TestVolumeBootPatternV346-1311400665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:27:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9431469bdf974894a3493b27bb04be38',uuid=23f383b0-ad1a-4cb1-8afb-d792e9488982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:22.333805 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converting VIF {"id": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "address": "fa:16:3e:3d:1a:d0", "network": {"id": "cc8e591b-1864-4ad1-955e-6f08b1089f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1437491436-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12dc09d5d69246b19f02313d2f4596e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba80986-f6", "ovs_interfaceid": "0ba80986-f6be-499e-9b8b-704b524d4b6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:22.334338 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:22.334581 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:22.335493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:22.335700 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ba80986-f6, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:22.336787 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:22.338000 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:22.338457 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:22.338624 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65b75484-0fab-4008-886a-528f25457295) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:22.339100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:22.339706 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:22.340007 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:22.341746 np0000000669 nova-compute[97951]: INFO os_vif [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:1a:d0,bridge_name='br-int',has_traffic_filtering=True,id=0ba80986-f6be-499e-9b8b-704b524d4b6e,network=Network(cc8e591b-1864-4ad1-955e-6f08b1089f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba80986-f6')
May 13 04:30:22.343335 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:22.343653 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:22.343799 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:22.344129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:22.344512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8a3db7-cc0b-4e38-a166-c26541be9db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:22.344666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:22.369143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:22.369143 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:22.369143 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:22.369143 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:22.369143 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:22.369315 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:22.369315 np0000000669 nova-compute[97951]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9 (non-flash)
May 13 04:30:22.369315 np0000000669 nova-compute[97951]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:22.369315 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:22.369315 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:22.369462 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:22.369703 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '170')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:22.370618 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9', '171')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:22.371421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a464812afc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:22.371666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:22.371905 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Flush multipath device 3300000006070652d {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:22.428693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:22.492967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:22.545688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:22.546071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:22.546506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:22.557596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:22.557754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:22.569710 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.597144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.40.100,3260]
May 13 04:30:22.597144 np0000000669 nova-compute[97951]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.40.100,3260] successful.
May 13 04:30:22.597144 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.612173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.623246 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.655417 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.50.100,3260]
May 13 04:30:22.655417 np0000000669 nova-compute[97951]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-ba8a3db7-cc0b-4e38-a166-c26541be9db9, portal: 192.168.50.100,3260] successful.
May 13 04:30:22.655417 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.668177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:22.668402 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:22.668509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] <== disconnect_volume: return (324ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:22.668618 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:22.668846 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Deleting instance files /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982_del
May 13 04:30:22.669313 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Deletion of /opt/stack/data/nova/instances/23f383b0-ad1a-4cb1-8afb-d792e9488982_del complete
May 13 04:30:23.020626 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:23.175310 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Took 1.66 seconds to destroy the instance on the hypervisor.
May 13 04:30:23.175877 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:23.176277 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:23.176436 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:23.176687 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:23.283302 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:23.744922 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:23.745268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:23.745268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:23.745431 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:23.745492 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] No waiting events found dispatching network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:23.745622 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9a3b7585-60e0-4ccd-a387-7b7460db51b0 req-6a96ac44-b1ad-4354-ba45-15fdecfd376c service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-unplugged-0ba80986-f6be-499e-9b8b-704b524d4b6e for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:24.087393 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:24.209698 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:24.583111 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:24.711494 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Took 1.53 seconds to deallocate network for instance.
May 13 04:30:25.088703 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
May 13 04:30:25.089166 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid 893e850e-29a9-4a2d-8272-6c5106153d97 {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:30:25.089664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Triggering sync for uuid 23f383b0-ad1a-4cb1-8afb-d792e9488982 {{(pid=97951) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 04:30:25.089856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:25.090000 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:25.090526 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:25.090779 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Took 0.56 seconds to detach 1 volumes for instance.
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-467faa99-9df1-40f2-b499-c7d04e783967 req-8f9f9cef-a5ea-4524-9f66-933518dc1f4f service nova] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Received event network-vif-deleted-0ba80986-f6be-499e-9b8b-704b524d4b6e {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:26.152664 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:26.421410 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:26.470963 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:26.978150 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.198s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:27.047991 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Deleted allocations for instance 23f383b0-ad1a-4cb1-8afb-d792e9488982
May 13 04:30:27.340187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:27.349619 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003441660001044511 future=<Future at 0x7a4648536f60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:27.351092 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:27.351213 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.2348750629998904 future=<Future at 0x7a463c19dd60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:27.351289 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=3.2347802889999 future=<Future at 0x7a463c19dd60 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:27.351536 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Emitting event <LifecycleEvent: 1778646612.3491745, 0007dd3e-b366-4789-84a8-6b7983f4375e => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:27.351661 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] VM Stopped (Lifecycle Event)
May 13 04:30:27.854411 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 0007dd3e-b366-4789-84a8-6b7983f4375e] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:28.034373 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:28.056378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-25d85ce7-0645-48fa-8f65-57f5ac7623f1 tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.049s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:28.057268 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.966s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:28.057350 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 04:30:28.057471 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "23f383b0-ad1a-4cb1-8afb-d792e9488982" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:30.448685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:30.586501 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003880240001308266 future=<Future at 0x7a463c19dd60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:30.587001 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:30.587001 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.2395863360002295 future=<Future at 0x7a461c756180 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:30.587001 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=6.23949848500024 future=<Future at 0x7a461c756180 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:30.588617 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Emitting event <LifecycleEvent: 1778646615.5860214, eb39b253-78ff-4768-aec4-cde1a39f1217 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:30.588762 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] VM Stopped (Lifecycle Event)
May 13 04:30:30.771764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:31.090936 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5b2d53bc-b076-425c-85c4-53e870691c53 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: eb39b253-78ff-4768-aec4-cde1a39f1217] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:31.586505 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:31.587097 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:32.083539 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:32.083821 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:32.179698 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:32.343862 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:32.588356 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:32.588704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:32.588735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:32.588945 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:30:32.763426 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:33.611119 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-16 (vda) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:30:33.612996 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:30:33.613964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:33.663395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:33.664157 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13810MB free_disk=72.74071884155273GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:30:33.664345 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:33.664583 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:34.020205 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:34.722039 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 893e850e-29a9-4a2d-8272-6c5106153d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:30:34.722373 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:30:34.722373 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:30:33 up 44 min,  2 users,  load average: 3.68, 5.05, 4.90\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_7988aac1411045f0b97e046631509aac': '1', 'io_workload': '0'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:30:34.729485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:34.729681 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:34.729910 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:34.730065 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:34.730214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:34.732664 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Terminating instance
May 13 04:30:34.812666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:34.813130 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:35.236306 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:30:35.250433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.268849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.275855 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.292699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.297334 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.315784 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:35.393198 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:35.393547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:35.393713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:35.393852 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:35.393963 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] No waiting events found dispatching network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:35.394072 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ac43755-6cc5-4436-b21d-ec5aaefeadc6 req-2fba8b4a-38b4-499f-bc7f-6daf83d0d664 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:35.450427 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:35.542953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:35.543209 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:35.577371 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999626386000273 future=<Future at 0x7a461c756e40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:35.579119 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Instance destroyed successfully.
May 13 04:30:35.579644 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lazy-loading 'resources' on Instance uuid 893e850e-29a9-4a2d-8272-6c5106153d97 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:35.823304 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:30:35.823817 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.159s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:35.823965 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:36.045647 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:30:36.082223 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-800368727',display_name='tempest-TestEncryptedCinderVolumes-server-800368727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testencryptedcindervolumes-server-800368727',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXh5LubGZiyAouUEEOPm+vtbiLjPVHE3qlXhZU40+P88rBDLq0b0cv3brDt09VYo67DbpDW3+8P0Y1C6xpzmYsabOEXU2Zm9WPV+nWt1uWF1e5wKZtNp/A7TuzwB2TrRg==',key_name='tempest-TestEncryptedCinderVolumes-2144040474',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:29:56Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7988aac1411045f0b97e046631509aac',ramdisk_id='',reservation_id='r-6okane90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1387017513',owner_user_name='tempest-TestEncryptedCinderVolumes-1387017513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:29:56Z,user_data=None,user_id='cb359d584a0b41398ca70e7e57fd589f',uuid=893e850e-29a9-4a2d-8272-6c5106153d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:30:36.082423 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converting VIF {"id": "a8168b5f-6312-4b64-b2b1-66e301846a54", "address": "fa:16:3e:d6:1a:97", "network": {"id": "5cbc16d3-e384-4ddb-8be8-2e270b46f134", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-969898591-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7988aac1411045f0b97e046631509aac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8168b5f-63", "ovs_interfaceid": "a8168b5f-6312-4b64-b2b1-66e301846a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:36.083190 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:36.083554 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:30:36.085000 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:36.085232 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8168b5f-63, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:36.086276 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:36.087146 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:36.088199 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:36.088374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45f10cf4-0de2-4731-b29f-535fba706c6b) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:36.088918 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:36.089419 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:36.092586 np0000000669 nova-compute[97951]: INFO os_vif [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1a:97,bridge_name='br-int',has_traffic_filtering=True,id=a8168b5f-6312-4b64-b2b1-66e301846a54,network=Network(5cbc16d3-e384-4ddb-8be8-2e270b46f134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8168b5f-63')
May 13 04:30:36.095900 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:30:36.096362 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-16'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:30:36.096555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:30:36.097142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:30:36.097414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1229429-7f69-4a2c-92a3-b8965178116e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-16'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:30:36.097928 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:30:36.122662 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:36.122662 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:36.122662 np0000000669 nova-compute[97951]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef (non-flash)
May 13 04:30:36.122662 np0000000669 nova-compute[97951]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef (non-flash)
May 13 04:30:36.122662 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:30:36.122957 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:36.122957 np0000000669 nova-compute[97951]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e (non-flash)
May 13 04:30:36.122957 np0000000669 nova-compute[97951]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef (non-flash)
May 13 04:30:36.122957 np0000000669 nova-compute[97951]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef (non-flash)
May 13 04:30:36.122957 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:30:36.123092 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-745ac4e9-b7cd-41c0-93a1-8a0e2f069bef', '197')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:30:36.123092 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '194')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:36.123967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e', '195')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:30:36.124588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'): ({'sdo'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:30:36.124871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Removing multipathed devices sdn, sdo {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:30:36.125095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Flush multipath device 3300000004967f5e2 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:30:36.169870 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:36.221214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:30:36.274875 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:30:36.275036 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:30:36.275909 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:30:36.288985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:30:36.289216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:30:36.302338 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.329637 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.40.100,3260]
May 13 04:30:36.329637 np0000000669 nova-compute[97951]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.40.100,3260] successful.
May 13 04:30:36.329637 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.345360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.357708 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.392684 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.50.100,3260]
May 13 04:30:36.392684 np0000000669 nova-compute[97951]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-a1229429-7f69-4a2c-92a3-b8965178116e, portal: 192.168.50.100,3260] successful.
May 13 04:30:36.392684 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.404533 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:30:36.405295 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:30:36.405432 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] <== disconnect_volume: return (308ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:30:36.405558 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:30:36.405809 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Deleting instance files /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97_del
May 13 04:30:36.406244 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Deletion of /opt/stack/data/nova/instances/893e850e-29a9-4a2d-8272-6c5106153d97_del complete
May 13 04:30:36.600410 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:36.600662 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:36.604113 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:30:36.604265 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Claim successful on node np0000000669
May 13 04:30:36.823812 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:36.824301 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:36.824301 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:36.824634 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.26 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:36.827449 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0009383369997522095 future=<Future at 0x7a461c756180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:36.828216 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] Emitting event <LifecycleEvent: 1778646621.8264298, 23f383b0-ad1a-4cb1-8afb-d792e9488982 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:36.828452 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:36.828661 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] VM Stopped (Lifecycle Event)
May 13 04:30:36.829866 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.747111311000026 future=<Future at 0x7a461c756e40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:36.830874 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=13.746091343999979 future=<Future at 0x7a461c756e40 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:36.913316 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Took 1.68 seconds to destroy the instance on the hypervisor.
May 13 04:30:36.914838 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:30:36.914838 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:30:36.914966 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:30:36.915261 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:36.988970 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:37.083671 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:37.083932 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:37.331452 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-ff64787b-2ddb-4804-a109-2ad0c901f21a tempest-TestVolumeBootPatternV346-1311400665 tempest-TestVolumeBootPatternV346-1311400665-project-member] [instance: 23f383b0-ad1a-4cb1-8afb-d792e9488982] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:37.476369 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:37.477424 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] Acquiring lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:37.477576 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:37.477680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] Lock "893e850e-29a9-4a2d-8272-6c5106153d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:37.477806 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] No waiting events found dispatching network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:37.478098 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-769fe3ef-de34-4ae6-ba70-cb144acef0dd req-478ce30d-a609-4212-b890-ca1327e4839e service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-unplugged-a8168b5f-6312-4b64-b2b1-66e301846a54 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:30:37.779667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:37.779888 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:37.967620 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:38.083828 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:30:38.083828 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:30:38.084286 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:30:38.284859 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:38.470093 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Took 1.56 seconds to deallocate network for instance.
May 13 04:30:38.597231 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:38.791511 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.191s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:38.791955 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:30:39.022391 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Took 0.55 seconds to detach 1 volumes for instance.
May 13 04:30:39.297015 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:30:39.297614 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:30:39.297970 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:39.298308 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:39.375957 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ff448bdb77a4738ad86bb77fc7722d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09189a0661453fb7c73feed890f08f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:30:39.528237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:39.528875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:39.548129 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c6b4a6a9-ab37-4aca-a0b2-5fd4c584d32f req-5d343abc-0f26-4061-8319-0cb5e221b399 service nova] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Received event network-vif-deleted-a8168b5f-6312-4b64-b2b1-66e301846a54 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:39.671667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:30:39.671898 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:30:39.802383 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:30:39.826732 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Successfully created port: 79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:30:40.174464 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:30:40.304173 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:30:40.349866 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Successfully updated port: 79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:30:40.397298 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-changed-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:40.397500 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Refreshing instance network info cache due to event network-changed-79dabe34-8df1-4974-80a9-d3eefc10ddac. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:30:40.397698 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] Acquiring lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:30:40.397822 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] Acquired lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:30:40.397954 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Refreshing network info cache for port 79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:30:40.450110 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:40.685157 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.155s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:40.740051 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Deleted allocations for instance 893e850e-29a9-4a2d-8272-6c5106153d97
May 13 04:30:40.850311 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:40.851770 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:30:40.899973 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:40.960060 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:30:41.084774 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:41.086615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:41.086615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:41.086615 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:41.086615 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] No waiting events found dispatching network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:41.086615 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9ac96767-4f00-4714-bfb2-2375a408cf14 req-51e6a4fc-0730-4c33-b23d-6a90ddca1e83 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received unexpected event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac for instance with vm_state building and task_state spawning.
May 13 04:30:41.089793 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:41.099295 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:41.314168 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:30:41.315169 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:30:41.315406 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Creating image(s)
May 13 04:30:41.315811 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:41.315994 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:41.316497 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:41.317201 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:30:41.321344 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:30:41.322712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:41.443084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.120s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:41.443545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:41.444038 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:41.444478 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:30:41.446937 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:30:41.447229 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:41.476145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:41.543280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:41.544014 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:41.601718 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk 1073741824" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:41.602796 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b12e3eac-17ec-4ee2-8852-a1544467213c req-54a7aa16-7d69-4db3-8011-38d32133956d service nova] Releasing lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:30:41.603815 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:41.604117 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquired lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:30:41.604313 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:30:41.605908 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:41.697803 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.092s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:41.698260 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:30:41.698590 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:41.751231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-809200dd-c2fe-4134-9dd9-30d5d6b45d83 tempest-TestEncryptedCinderVolumes-1387017513 tempest-TestEncryptedCinderVolumes-1387017513-project-member] Lock "893e850e-29a9-4a2d-8272-6c5106153d97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.021s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:41.789147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:41.789654 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Cannot resize image /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:30:41.790228 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:30:41.790462 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Ensure instance console log exists: /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:30:41.790774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:41.791053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:41.791176 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:42.169067 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:30:42.320471 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:42.482748 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating instance_info_cache with network_info: [{"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:42.987395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Releasing lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:30:42.987524 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance network_info: |[{"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:30:42.989791 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Start _get_guest_xml network_info=[{"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:30:42.996727 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:30:42.998261 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-808502114', uuid='1193eae6-8a0e-43f7-a572-077d3253a0ce'), owner=OwnerMeta(userid='3ff448bdb77a4738ad86bb77fc7722d9', username='tempest-TestServerVolumeAttachmentScenario-1954786639-project-member', projectid='cb09189a0661453fb7c73feed890f08f', projectname='tempest-TestServerVolumeAttachmentScenario-1954786639'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646642.9978304) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:30:43.000313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:30:43.000704 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:30:43.001997 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:30:43.002195 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:30:43.003531 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:30:43.003943 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:30:43.004112 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:30:43.004226 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:30:43.004488 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:30:43.004622 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:30:43.004746 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:30:43.004920 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:30:43.005048 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:30:43.005174 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:30:43.005295 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:30:43.005461 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:30:43.020665 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-808502114',display_name='tempest-TestServerVolumeAttachmentScenario-server-808502114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachmentscenario-server-808502114',id=76,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs3Yjmdd0ApVf2u0tb9sX50YtiKjkF+rI1fn+8X9dwccLZ2liR00G8auNyVz4idp2zNHC0oJZRC1RKwjaruIHLjc0ZPM5lgz69RWL7I3Tw9bpf+EG3Eev+Zm1D14QteCQ==',key_name='tempest-keypair-378555698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb09189a0661453fb7c73feed890f08f',ramdisk_id='',reservation_id='r-mni07p6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1954786639',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1954786639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff448bdb77a4738ad86bb77fc7722d9',uuid=1193eae6-8a0e-43f7-a572-077d3253a0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:30:43.020842 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converting VIF {"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:43.021495 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:43.022123 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'pci_devices' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:30:43.525182 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] End _get_guest_xml xml=<domain type="qemu">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <uuid>1193eae6-8a0e-43f7-a572-077d3253a0ce</uuid>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <name>instance-0000004c</name>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-808502114</nova:name>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:30:42</nova:creationTime>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:user uuid="3ff448bdb77a4738ad86bb77fc7722d9">tempest-TestServerVolumeAttachmentScenario-1954786639-project-member</nova:user>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:project uuid="cb09189a0661453fb7c73feed890f08f">tempest-TestServerVolumeAttachmentScenario-1954786639</nova:project>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         <nova:port uuid="79dabe34-8df1-4974-80a9-d3eefc10ddac">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <system>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="serial">1193eae6-8a0e-43f7-a572-077d3253a0ce</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="uuid">1193eae6-8a0e-43f7-a572-077d3253a0ce</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </system>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <os>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </os>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <features>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </features>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   <devices>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </disk>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.config"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </disk>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:86:7f:21"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <target dev="tap79dabe34-8d"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </interface>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/console.log" append="off"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </serial>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <video>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </video>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </rng>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:   </devices>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]: </domain>
May 13 04:30:43.525182 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Preparing to wait for external event network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-808502114',display_name='tempest-TestServerVolumeAttachmentScenario-server-808502114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachmentscenario-server-808502114',id=76,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs3Yjmdd0ApVf2u0tb9sX50YtiKjkF+rI1fn+8X9dwccLZ2liR00G8auNyVz4idp2zNHC0oJZRC1RKwjaruIHLjc0ZPM5lgz69RWL7I3Tw9bpf+EG3Eev+Zm1D14QteCQ==',key_name='tempest-keypair-378555698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb09189a0661453fb7c73feed890f08f',ramdisk_id='',reservation_id='r-mni07p6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1954786639',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1954786639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff448bdb77a4738ad86bb77fc7722d9',uuid=1193eae6-8a0e-43f7-a572-077d3253a0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converting VIF {"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:30:43.527452 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:30:43.527800 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:30:43.528182 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.528665 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:43.529043 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:30:43.529776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.530001 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a49aa96-a922-5cf5-9eb3-8219c78ef9ef', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:43.540419 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.541468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:43.542074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.544172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.544392 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79dabe34-8d, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:43.544798 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79dabe34-8d, col_values=(('qos', UUID('dda51d0b-6e77-4e84-9907-324bb85e336e')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:43.545016 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79dabe34-8d, col_values=(('external_ids', {'iface-id': '79dabe34-8df1-4974-80a9-d3eefc10ddac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:7f:21', 'vm-uuid': '1193eae6-8a0e-43f7-a572-077d3253a0ce'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:30:43.545981 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.548638 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:30:43.552086 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:43.553217 np0000000669 nova-compute[97951]: INFO os_vif [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d')
May 13 04:30:45.068810 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:30:45.069286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:30:45.069286 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No VIF found with MAC fa:16:3e:86:7f:21, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:30:45.069462 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Using config drive
May 13 04:30:45.450494 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:45.575749 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:45.695803 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Creating config drive at /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.config
May 13 04:30:45.699500 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe2fchwhc {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:30:45.752722 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe2fchwhc" returned: 0 in 0.053s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:30:46.220679 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.238938 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.240403 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.340849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.422787 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-48ffde10-f2e3-4dc8-a91c-a7c340219eb5 req-bfd31c17-1d86-4a8b-989f-353140b9a0b1 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:46.423087 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-48ffde10-f2e3-4dc8-a91c-a7c340219eb5 req-bfd31c17-1d86-4a8b-989f-353140b9a0b1 service nova] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:46.423361 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-48ffde10-f2e3-4dc8-a91c-a7c340219eb5 req-bfd31c17-1d86-4a8b-989f-353140b9a0b1 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:46.423569 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-48ffde10-f2e3-4dc8-a91c-a7c340219eb5 req-bfd31c17-1d86-4a8b-989f-353140b9a0b1 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:46.423708 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-48ffde10-f2e3-4dc8-a91c-a7c340219eb5 req-bfd31c17-1d86-4a8b-989f-353140b9a0b1 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Processing event network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:30:46.531251 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.534540 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.549900 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:46.702645 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:47.041083 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646647.0404158, 1193eae6-8a0e-43f7-a572-077d3253a0ce => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:47.041083 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] VM Started (Lifecycle Event)
May 13 04:30:47.041819 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:30:47.046296 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:30:47.049803 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance spawned successfully.
May 13 04:30:47.049803 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:30:47.545966 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:47.548012 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:30:47.557836 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:47.557836 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:47.558039 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:47.558294 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:47.558693 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:47.559158 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:30:48.050721 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:30:48.051529 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646648.050779, 1193eae6-8a0e-43f7-a572-077d3253a0ce => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:48.051529 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] VM Paused (Lifecycle Event)
May 13 04:30:48.064336 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Took 6.75 seconds to spawn the instance on the hypervisor.
May 13 04:30:48.064809 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:48.484602 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:48.498594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:48.499083 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:30:48.501748 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:30:48.503338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:48.503338 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] No waiting events found dispatching network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:30:48.503338 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-c62d95c5-2202-44ec-8f8c-e37d49fa22e0 req-87398e44-95eb-43af-b04c-db09eab10d1c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received unexpected event network-vif-plugged-79dabe34-8df1-4974-80a9-d3eefc10ddac for instance with vm_state active and task_state None.
May 13 04:30:48.546880 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:48.554494 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:48.557134 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646648.5568886, 1193eae6-8a0e-43f7-a572-077d3253a0ce => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:48.557254 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] VM Resumed (Lifecycle Event)
May 13 04:30:48.577315 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Took 12.03 seconds to build instance.
May 13 04:30:49.067991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:49.072360 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:30:49.081845 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-72641935-5ba0-4d7f-9d9a-cbb6b041cfe8 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.538s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:30:49.297966 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-changed-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:30:49.300102 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Refreshing instance network info cache due to event network-changed-79dabe34-8df1-4974-80a9-d3eefc10ddac. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:30:49.300289 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] Acquiring lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:30:49.300396 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] Acquired lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:30:49.300496 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Refreshing network info cache for port 79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:30:49.803293 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:50.149703 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:30:50.259061 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updated VIF entry in instance network info cache for port 79dabe34-8df1-4974-80a9-d3eefc10ddac. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:30:50.259332 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating instance_info_cache with network_info: [{"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:30:50.452059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:50.577776 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0006208849999893573 future=<Future at 0x7a461c756e40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:50.577929 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:30:50.578296 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] Emitting event <LifecycleEvent: 1778646635.576858, 893e850e-29a9-4a2d-8272-6c5106153d97 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:30:50.579502 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] VM Stopped (Lifecycle Event)
May 13 04:30:50.761084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-5e9f1d42-bf30-493f-9918-f21d8f789bc2 req-b36b43d1-8419-4dc1-b6bf-0f9bbcfbd03c service nova] Releasing lock "refresh_cache-1193eae6-8a0e-43f7-a572-077d3253a0ce" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:30:51.081145 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fc2a20ff-3331-4ba4-a0eb-17c9b0271355 tempest-AttachVolumeMultiAttachTest-1762651840 tempest-AttachVolumeMultiAttachTest-1762651840-project-member] [instance: 893e850e-29a9-4a2d-8272-6c5106153d97] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:30:53.550928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:55.466825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:30:58.554600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:00.476254 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:03.557504 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:05.477716 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:08.567384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:10.479611 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:13.570014 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:14.072150 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:15.482599 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:15.589076 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:17.910344 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:18.572038 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:19.171581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:20.483918 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:22.433996 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:22.435677 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:22.936921 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:31:23.487469 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:23.487858 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:23.490962 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:31:23.491120 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Claim successful on node np0000000669
May 13 04:31:23.572948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:24.620224 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:31:24.620616 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:31:25.122874 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:31:25.485242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:25.629354 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.142s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:25.629723 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:31:25.744140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:25.744551 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:26.134846 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:31:26.134958 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:31:26.135180 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:26.135419 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:26.200360 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b8bb448acc641ed89797bcaf8e7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8598c291629242869fa2a040db124338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:31:26.248006 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:26.637536 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:31:26.662917 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Successfully created port: 671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:31:27.050562 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Successfully updated port: 671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:31:27.114549 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-changed-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:27.115590 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Refreshing instance network info cache due to event network-changed-671a5aa8-080d-4872-a0b6-47ef96c2f46b. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:31:27.115835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] Acquiring lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:31:27.116048 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] Acquired lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:31:27.116087 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Refreshing network info cache for port 671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:31:27.140528 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:31:27.254951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:27.552418 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:31:27.617840 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:27.678663 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:31:27.800856 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] No waiting events found dispatching network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:31:28.053372 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-aedd6f0e-c3ce-47ba-a8e4-528d1a5cf75d req-5ee70400-2333-43e5-9a06-783a72acb626 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received unexpected event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b for instance with vm_state building and task_state spawning.
May 13 04:31:28.149902 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:31:28.150715 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:31:28.150943 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Creating image(s)
May 13 04:31:28.151385 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:28.151547 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:28.151964 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:28.152595 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:31:28.155458 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:31:28.156467 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.252553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:28.253006 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:28.253669 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:28.254179 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:31:28.260004 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:31:28.260507 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.303522 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-c4581a0c-4c7e-4413-8ea8-e4fd0ff29573 req-95e05be4-d7ff-4bd7-ada7-4b8667d8e823 service nova] Releasing lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:31:28.304493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquired lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:31:28.304737 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:31:28.311560 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:28.311759 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:28.311979 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attaching volume 45b9989b-1295-4f41-9a35-9c93cc8ca7a0 to /dev/vdb
May 13 04:31:28.347612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:28.348108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.363242 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:28.373130 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:31:28.393214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.411080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk 1073741824" returned: 0 in 0.062s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:28.412218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:28.413227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.449987 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:31:28.450387 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:31:28.459879 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:31:28.460669 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe86:7f21', 'fe80::d091:a2ff:fe8d:d9a2'] 
May 13 04:31:28.460769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:31:28.460865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:31:28.461100 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:28.461388 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating existing volume attachment record: dcd1f1fc-c116-450e-918c-e0cb20c761db {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:31:28.501762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:28.502192 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:31:28.502452 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:28.575412 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:28.592521 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:28.593579 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Cannot resize image /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:31:28.593903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:31:28.594055 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Ensure instance console log exists: /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:31:28.594334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:28.594557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:28.594695 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:28.864462 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:31:28.999213 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:29.037692 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:31:29.038005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:29.038187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:29.038598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:29.038863 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:31:29.050208 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:29.050773 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:29.051262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:29.051511 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:31:29.052042 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:29.052235 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:31:29.063230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:31:29.063230 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:29.067639 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:31:29.067639 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0] added
May 13 04:31:29.074343 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:29.074343 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:31:29.074343 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:31:29.079148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0] added
May 13 04:31:29.079148 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:31:29.079148 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:29.079148 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:29.079148 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:29.079148 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:29.079148 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:29.079412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:31:29.079463 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:31:29.079587 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:31:29.116151 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating instance_info_cache with network_info: [{"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:31:29.618925 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Releasing lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:31:29.619723 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance network_info: |[{"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:31:29.621006 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Start _get_guest_xml network_info=[{"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:31:29.623421 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:31:29.624682 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1032014400', uuid='b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3'), owner=OwnerMeta(userid='4b8bb448acc641ed89797bcaf8e7a639', username='tempest-SnapshotDataIntegrityTests-1376363296-project-member', projectid='8598c291629242869fa2a040db124338', projectname='tempest-SnapshotDataIntegrityTests-1376363296'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646689.624355) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:31:29.625792 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:31:29.626110 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:31:29.626993 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:31:29.627175 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:31:29.628115 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:31:29.628476 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:31:29.628632 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:31:29.628733 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:31:29.628862 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:31:29.628958 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:31:29.629058 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:31:29.629234 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:31:29.629353 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:31:29.629472 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:31:29.629583 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:31:29.629708 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:31:29.642996 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032014400',display_name='tempest-SnapshotDataIntegrityTests-server-1032014400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-snapshotdataintegritytests-server-1032014400',id=77,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFJtq0IS5LiFN7xL9YXiKi75qR+pmxBGAju0mrqdMML9EOe5Cx/ZlpR8euD3oU8yTDWJ+cWmLIlt61TmHASPzPllXWpWkf0qzykmjSva4F9XlEmxuwZh/TzUBh08Xlubg==',key_name='tempest-keypair-1665837235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8598c291629242869fa2a040db124338',ramdisk_id='',reservation_id='r-vy2m4oq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1376363296',owner_user_name='tempest-SnapshotDataIntegrityTests-1376363296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:31:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8bb448acc641ed89797bcaf8e7a639',uuid=b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:31:29.643137 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converting VIF {"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:31:29.643766 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:31:29.644316 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'pci_devices' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:30.074713 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:31:30.080040 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:31:30.086407 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:31:30.086407 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:31:30.094507 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:31:30.094507 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.100790 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.106425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.111760 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.111760 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:30.111916 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.111916 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:30.120050 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.120050 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:30.120176 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.120176 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:30.146813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] End _get_guest_xml xml=<domain type="qemu">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <uuid>b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3</uuid>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <name>instance-0000004d</name>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1032014400</nova:name>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:31:29</nova:creationTime>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:user uuid="4b8bb448acc641ed89797bcaf8e7a639">tempest-SnapshotDataIntegrityTests-1376363296-project-member</nova:user>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:project uuid="8598c291629242869fa2a040db124338">tempest-SnapshotDataIntegrityTests-1376363296</nova:project>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         <nova:port uuid="671a5aa8-080d-4872-a0b6-47ef96c2f46b">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <system>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="serial">b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="uuid">b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </system>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <os>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </os>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <features>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </features>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   <devices>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.config"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </disk>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:90:f2:26"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <target dev="tap671a5aa8-08"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </interface>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/console.log" append="off"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </serial>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <video>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </video>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </rng>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:   </devices>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]: </domain>
May 13 04:31:30.146813 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Preparing to wait for external event network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032014400',display_name='tempest-SnapshotDataIntegrityTests-server-1032014400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-snapshotdataintegritytests-server-1032014400',id=77,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFJtq0IS5LiFN7xL9YXiKi75qR+pmxBGAju0mrqdMML9EOe5Cx/ZlpR8euD3oU8yTDWJ+cWmLIlt61TmHASPzPllXWpWkf0qzykmjSva4F9XlEmxuwZh/TzUBh08Xlubg==',key_name='tempest-keypair-1665837235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8598c291629242869fa2a040db124338',ramdisk_id='',reservation_id='r-vy2m4oq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1376363296',owner_user_name='tempest-SnapshotDataIntegrityTests-1376363296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:31:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8bb448acc641ed89797bcaf8e7a639',uuid=b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:31:30.148707 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converting VIF {"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:31:30.149333 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:31:30.149593 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:31:30.150085 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.150666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.40.100,3260]
May 13 04:31:30.150666 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.40.100,3260] successful.
May 13 04:31:30.150666 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.151145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:30.151145 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:31:30.151800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.151800 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b1d1738-7d1f-523f-870b-028f34c8dac6', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:30.164236 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:30.164802 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.165590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:31:30.165845 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.167683 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.167965 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap671a5aa8-08, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:30.168081 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap671a5aa8-08, col_values=(('qos', UUID('5b764238-f1cd-4433-8ce1-d66f06236796')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:30.168248 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap671a5aa8-08, col_values=(('external_ids', {'iface-id': '671a5aa8-080d-4872-a0b6-47ef96c2f46b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:f2:26', 'vm-uuid': 'b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:30.169381 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.170303 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:31:30.173495 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.173495 np0000000669 nova-compute[97951]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:30.173495 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:30.173612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:30.173612 np0000000669 nova-compute[97951]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:30.173612 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:30.173837 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:30.173945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:31:30.174448 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] HCTL ('8', '-', '-', 0) found on session 202 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:31:30.175059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:30.175707 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:31:30.176176 np0000000669 nova-compute[97951]: INFO os_vif [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08')
May 13 04:31:30.188285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 202 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:30.188285 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:31:30.486384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:31.079339 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:31.079665 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:31.148550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.50.100,3260]
May 13 04:31:31.148550 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.50.100,3260] successful.
May 13 04:31:31.148550 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:31.159023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:31.173962 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.122s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] HCTL ('9', '-', '-', 0) found on session 203 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:31:31.173962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:31:31.188075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 203 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:31.188075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:31:31.692989 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:31.693199 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:31.693199 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No VIF found with MAC fa:16:3e:90:f2:26, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:31:31.693591 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Using config drive
May 13 04:31:32.083711 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:32.084080 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:32.100952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found WWN 33000000025c5b4d8 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:31:32.101264 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.063s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:32.101497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== connect_volume: return (3062ms) {'type': 'block', 'scsi_wwn': '33000000025c5b4d8', 'path': '/dev/dm-0', 'multipath_id': '33000000025c5b4d8'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:32.101619 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000025c5b4d8', 'path': '/dev/dm-0', 'multipath_id': '33000000025c5b4d8'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:31:32.104162 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:32.198360 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:32.303748 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Creating config drive at /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.config
May 13 04:31:32.307386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmlzmtonr {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:32.359602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmlzmtonr" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:32.610813 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attempting to attach volume 45b9989b-1295-4f41-9a35-9c93cc8ca7a0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:31:32.612298 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:   <alias name="ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0"/>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:   <serial>45b9989b-1295-4f41-9a35-9c93cc8ca7a0</serial>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:32.612298 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:31:32.864186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:32.882295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:32.962776 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:33.044334 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f811fc13-0f4c-49e8-b0da-78ccd5e4109b req-3711c5ea-5026-49be-925a-b0a9129ce64f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:33.044566 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f811fc13-0f4c-49e8-b0da-78ccd5e4109b req-3711c5ea-5026-49be-925a-b0a9129ce64f service nova] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:33.044798 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f811fc13-0f4c-49e8-b0da-78ccd5e4109b req-3711c5ea-5026-49be-925a-b0a9129ce64f service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:33.044941 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-f811fc13-0f4c-49e8-b0da-78ccd5e4109b req-3711c5ea-5026-49be-925a-b0a9129ce64f service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:33.045098 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-f811fc13-0f4c-49e8-b0da-78ccd5e4109b req-3711c5ea-5026-49be-925a-b0a9129ce64f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Processing event network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:31:33.083753 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:33.084258 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:33.182828 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:33.185191 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:33.187764 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:33.209279 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:33.589704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:33.589900 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:33.590032 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:33.590178 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:31:33.596894 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646693.596657, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:31:33.597007 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] VM Started (Lifecycle Event)
May 13 04:31:33.598223 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:31:33.600667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:31:33.604175 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance spawned successfully.
May 13 04:31:33.604475 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:31:34.100721 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:31:34.104762 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:31:34.110426 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.110552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.110782 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.111020 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.112640 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.112958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:31:34.292583 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:34.292717 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:34.292838 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:34.292959 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No VIF found with MAC fa:16:3e:86:7f:21, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:31:34.608420 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:31:34.608648 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646694.6084733, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:31:34.608779 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] VM Paused (Lifecycle Event)
May 13 04:31:34.617544 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Took 6.47 seconds to spawn the instance on the hypervisor.
May 13 04:31:34.617842 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:31:34.619704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:34.714457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:34.714997 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:34.809948 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:34.810334 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:31:34.815169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:34.920252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:34.920763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:35.016951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:35.021810 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:31:35.023247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:35.070901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:31:35.071469 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13735MB free_disk=72.68148422241211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:31:35.071674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:35.072018 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:35.108687 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:35.109061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:35.109061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:35.109183 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:35.109335 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] No waiting events found dispatching network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:31:35.109651 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-d25fade0-2f78-4197-b3bd-8b8e7978b6d1 req-637b4542-f7c4-4b61-ad51-be16abc8d587 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received unexpected event network-vif-plugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b for instance with vm_state active and task_state None.
May 13 04:31:35.110747 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:31:35.112914 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646695.1127279, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:31:35.113098 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] VM Resumed (Lifecycle Event)
May 13 04:31:35.126498 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Took 11.69 seconds to build instance.
May 13 04:31:35.169778 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:35.487389 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:35.615171 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:31:35.618612 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:31:35.627819 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.193s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:35.851163 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b1ce599f-0ecd-4ce0-a14f-900281e8404e tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.539s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:36.134866 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 1193eae6-8a0e-43f7-a572-077d3253a0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:31:36.135333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:31:36.135333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:31:36.135333 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:31:35 up 45 min,  2 users,  load average: 3.65, 4.80, 4.83\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_cb09189a0661453fb7c73feed890f08f': '1', 'io_workload': '0', 'num_proj_8598c291629242869fa2a040db124338': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:31:36.292910 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:31:36.293125 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:31:36.540521 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-changed-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:36.540664 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Refreshing instance network info cache due to event network-changed-671a5aa8-080d-4872-a0b6-47ef96c2f46b. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:31:36.540802 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] Acquiring lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:31:36.540893 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] Acquired lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:31:36.541050 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Refreshing network info cache for port 671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:31:36.797840 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:31:37.045052 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:37.304890 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:31:37.305347 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.233s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:37.305411 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:37.395167 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:37.447955 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:37.448118 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:37.559530 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updated VIF entry in instance network info cache for port 671a5aa8-080d-4872-a0b6-47ef96c2f46b. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:31:37.559843 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating instance_info_cache with network_info: [{"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:31:37.956878 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:38.061956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1520c528-4182-404d-9ec1-56f0021d665a req-4ccb44bd-6ab2-4f18-9a59-0084b82a2e8f service nova] Releasing lock "refresh_cache-b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:31:38.961567 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:40.054786 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:40.055208 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:40.055208 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attaching volume 0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 to /dev/vdc
May 13 04:31:40.104120 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:40.105569 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:40.118684 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:31:40.144944 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:31:40.172741 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:40.192549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:31:40.192742 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:31:40.202615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:31:40.203876 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe86:7f21', 'fe80::d091:a2ff:fe8d:d9a2', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7'] 
May 13 04:31:40.204054 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:31:40.204223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:31:40.204554 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:40.204885 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating existing volume attachment record: 6df2fd65-0ed3-4607-9c42-4484494ddf5c {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:31:40.305171 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:40.305421 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:40.305732 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:40.305840 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:40.305997 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:31:40.306267 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.77 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:40.488423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:40.769731 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:31:40.770138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:40.770298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:40.771949 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:40.772202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:31:40.785675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:40.786458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:40.786952 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:40.787186 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:31:40.787687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:40.787928 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:31:40.798434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:31:40.798434 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:40.807159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:31:40.807159 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:40.813732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5] added
May 13 04:31:40.813732 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:31:40.813732 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:40.813732 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:40.813732 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:40.813732 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:40.813732 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:40.814019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:31:40.814144 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:31:40.814293 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:31:40.819890 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5] added
May 13 04:31:40.819890 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:31:40.819890 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:40.819890 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:40.819890 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:31:40.819890 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:31:40.819890 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:40.820147 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:31:40.820147 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:31:40.820270 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:31:41.814671 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:31:41.820604 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:31:41.827171 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:31:41.827171 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:31:41.834716 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:31:41.834716 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.841347 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.846593 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.854543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.854543 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.854543 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.854543 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:41.854775 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.854775 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.854775 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.854775 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:41.860067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.860067 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.860067 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.860067 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:41.860409 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.860409 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.860409 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.860409 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:41.888369 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.40.100,3260]
May 13 04:31:41.888369 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.40.100,3260] successful.
May 13 04:31:41.888369 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.900588 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.909701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.50.100,3260]
May 13 04:31:41.909701 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.50.100,3260] successful.
May 13 04:31:41.909701 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.916615 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:41.916615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:31:41.917434 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] HCTL ('10', '-', '-', 0) found on session 205 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:31:41.917581 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:31:41.923070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:41.935510 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 205 and hctl ['10', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:41.939513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.939513 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.939513 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.939513 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.939513 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.939513 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:41.939651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.939651 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:41.939651 np0000000669 nova-compute[97951]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:41.939651 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.939651 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:41.939651 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:41.939936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:41.940069 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:31:41.940688 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] HCTL ('11', '-', '-', 0) found on session 206 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:31:41.940820 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:31:41.953288 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 206 and hctl ['11', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:42.080736 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:31:42.081022 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:31:42.935743 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 205 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:42.936226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:31:42.954072 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Searching for a device in session 206 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:31:42.954279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:31:43.788304 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:31:44.805735 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found WWN 3300000009d0291ad for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:31:44.806121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:44.806121 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '3300000009d0291ad', 'path': '/dev/dm-1', 'multipath_id': '3300000009d0291ad'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:44.806317 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d0291ad', 'path': '/dev/dm-1', 'multipath_id': '3300000009d0291ad'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:31:44.809015 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:45.175194 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:45.312381 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attempting to attach volume 0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:31:45.313890 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:   <alias name="ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5"/>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:   <serial>0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5</serial>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:45.313890 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:31:45.496351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:46.954978 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:46.955340 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:46.955340 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:46.955340 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:31:46.955340 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] No VIF found with MAC fa:16:3e:86:7f:21, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:31:48.517706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-3b7ae331-20de-4d83-9857-6563776b521f tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.463s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:48.977110 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:48.977267 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:49.479705 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Detaching volume 0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5
May 13 04:31:49.518869 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attempting to driver detach volume 0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 from mountpoint /dev/vdc
May 13 04:31:49.524538 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found disk vdc by alias ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:31:49.525901 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found disk vdc by alias ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:31:49.526045 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Attempting to detach device vdc from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:31:49.526313 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <alias name="ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5"/>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <serial>0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5</serial>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:49.526313 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:31:49.533194 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully detached device vdc from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the persistent domain config.
May 13 04:31:49.533390 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] (1/8): Attempting to detach device vdc with device alias ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:31:49.533718 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <alias name="ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5"/>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-1"/>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <serial>0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5</serial>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:49.533718 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:31:50.028068 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646710.0277216, 1193eae6-8a0e-43f7-a572-077d3253a0ce => ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:31:50.029104 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 for instance 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:31:50.032304 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully detached device vdc from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the live domain config.
May 13 04:31:50.033641 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:31:50.033908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:50.034020 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:50.034304 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:50.034585 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:31:50.034693 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:31:50.060179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:50.060179 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:50.060179 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:50.060179 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:50.060179 np0000000669 nova-compute[97951]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:50.060179 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:50.060367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:50.060367 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:50.060367 np0000000669 nova-compute[97951]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:50.060367 np0000000669 nova-compute[97951]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5 (non-flash)
May 13 04:31:50.060367 np0000000669 nova-compute[97951]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:50.060367 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:50.060610 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54', '207')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:31:50.060826 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', '205')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:31:50.061745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5', '206')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:31:50.062680 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4652d77e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'): ({'sdf'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:31:50.062935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Removing multipathed devices sdf, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:31:50.063241 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Flush multipath device 3300000009d0291ad {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:31:50.104862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:31:50.149301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:31:50.177155 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:50.199691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:31:50.199691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:31:50.199691 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:31:50.210046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:31:50.210046 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:31:50.220217 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.250783 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.40.100,3260]
May 13 04:31:50.250783 np0000000669 nova-compute[97951]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.40.100,3260] successful.
May 13 04:31:50.250783 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.264009 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.276839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.306180 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.50.100,3260]
May 13 04:31:50.306180 np0000000669 nova-compute[97951]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-0fbe59a0-4d7a-440c-98af-4d9bfa76f5f5, portal: 192.168.50.100,3260] successful.
May 13 04:31:50.306180 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.319186 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:50.319666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:50.319666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== disconnect_volume: return (285ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:50.319666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:31:50.497389 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:50.867629 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:51.878098 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-1c3a0865-56fd-441b-ae22-d6ee6e5213c2 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.901s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:52.295090 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:52.295308 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:52.799333 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Detaching volume 45b9989b-1295-4f41-9a35-9c93cc8ca7a0
May 13 04:31:52.837708 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Attempting to driver detach volume 45b9989b-1295-4f41-9a35-9c93cc8ca7a0 from mountpoint /dev/vdb
May 13 04:31:52.843988 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found disk vdb by alias ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:31:52.845083 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Found disk vdb by alias ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:31:52.845187 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Attempting to detach device vdb from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:31:52.845442 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <alias name="ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0"/>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <serial>45b9989b-1295-4f41-9a35-9c93cc8ca7a0</serial>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:52.845442 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:31:52.857053 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully detached device vdb from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the persistent domain config.
May 13 04:31:52.857260 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] (1/8): Attempting to detach device vdb with device alias ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:31:52.857518 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <alias name="ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0"/>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <serial>45b9989b-1295-4f41-9a35-9c93cc8ca7a0</serial>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]: </disk>
May 13 04:31:52.857518 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:31:53.338856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646713.33856, 1193eae6-8a0e-43f7-a572-077d3253a0ce => ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:31:53.339923 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 for instance 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:31:53.342082 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully detached device vdb from instance 1193eae6-8a0e-43f7-a572-077d3253a0ce from the live domain config.
May 13 04:31:53.342976 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:31:53.343273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:31:53.343412 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:31:53.343701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:31:53.343934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:31:53.344067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:31:53.368022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:53.368022 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:53.368022 np0000000669 nova-compute[97951]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:53.368022 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:31:53.368279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:53.368279 np0000000669 nova-compute[97951]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0 (non-flash)
May 13 04:31:53.368279 np0000000669 nova-compute[97951]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54 (non-flash)
May 13 04:31:53.368279 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:31:53.368279 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5b77ceb-cbfb-4935-a3f1-bfc1e924ce54', '207')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:31:53.368439 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '202')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:31:53.369073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0', '203')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:31:53.369711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c6522a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:31:53.369871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:31:53.370086 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Flush multipath device 33000000025c5b4d8 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:31:53.406626 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:31:53.450231 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:31:53.497636 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:31:53.497861 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:31:53.498836 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:31:53.510226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:31:53.510476 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:31:53.522286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.555654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.40.100,3260]
May 13 04:31:53.555654 np0000000669 nova-compute[97951]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.40.100,3260] successful.
May 13 04:31:53.555654 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.574661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.585878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.612163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.50.100,3260]
May 13 04:31:53.612163 np0000000669 nova-compute[97951]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-45b9989b-1295-4f41-9a35-9c93cc8ca7a0, portal: 192.168.50.100,3260] successful.
May 13 04:31:53.612163 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.624534 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:31:53.624770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:31:53.624910 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] <== disconnect_volume: return (281ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:31:53.625174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:31:54.164751 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'flavor' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:55.177849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-63a9666b-10e1-4ecd-892a-a92c85af7181 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.882s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:55.178928 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:55.523505 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:55.630249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:55.630249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:55.630249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:55.630249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:55.630249 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:55.631964 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Terminating instance
May 13 04:31:56.134465 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:31:56.151015 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.170123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.193779 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.303187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:56.303445 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:56.303781 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:56.303904 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:56.304449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] No waiting events found dispatching network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:31:56.304449 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-151f11c5-e4c3-4a27-9974-0ea3ee987c03 req-b739b3f3-df8e-472e-b507-4a972f219fe3 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:31:56.390434 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.448545 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.456507 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.486455 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999648877000254 future=<Future at 0x7a463c715be0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:31:56.487156 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99835559100029 future=<Future at 0x7a463c715be0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:31:56.487156 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.998230882999906 future=<Future at 0x7a463c715be0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:31:56.489446 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Instance destroyed successfully.
May 13 04:31:56.489798 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lazy-loading 'resources' on Instance uuid 1193eae6-8a0e-43f7-a572-077d3253a0ce {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:31:56.995053 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-808502114',display_name='tempest-TestServerVolumeAttachmentScenario-server-808502114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-testservervolumeattachmentscenario-server-808502114',id=76,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs3Yjmdd0ApVf2u0tb9sX50YtiKjkF+rI1fn+8X9dwccLZ2liR00G8auNyVz4idp2zNHC0oJZRC1RKwjaruIHLjc0ZPM5lgz69RWL7I3Tw9bpf+EG3Eev+Zm1D14QteCQ==',key_name='tempest-keypair-378555698',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:30:48Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb09189a0661453fb7c73feed890f08f',ramdisk_id='',reservation_id='r-mni07p6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1954786639',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1954786639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff448bdb77a4738ad86bb77fc7722d9',uuid=1193eae6-8a0e-43f7-a572-077d3253a0ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:31:56.995358 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converting VIF {"id": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "address": "fa:16:3e:86:7f:21", "network": {"id": "73aef264-5846-49b1-b0ac-e28c69094398", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-494422310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb09189a0661453fb7c73feed890f08f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79dabe34-8d", "ovs_interfaceid": "79dabe34-8df1-4974-80a9-d3eefc10ddac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:31:56.995909 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:31:56.996178 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:31:56.998586 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:56.998885 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79dabe34-8d, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:56.999932 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:57.000804 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:31:57.000867 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:57.001479 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:57.001628 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dda51d0b-6e77-4e84-9907-324bb85e336e) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:31:57.002593 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:57.002593 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:31:57.002658 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:31:57.004142 np0000000669 nova-compute[97951]: INFO os_vif [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:7f:21,bridge_name='br-int',has_traffic_filtering=True,id=79dabe34-8df1-4974-80a9-d3eefc10ddac,network=Network(73aef264-5846-49b1-b0ac-e28c69094398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79dabe34-8d')
May 13 04:31:57.004450 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Deleting instance files /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce_del
May 13 04:31:57.005172 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Deletion of /opt/stack/data/nova/instances/1193eae6-8a0e-43f7-a572-077d3253a0ce_del complete
May 13 04:31:57.511196 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 04:31:57.511889 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:31:57.512187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:31:57.512301 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:31:57.512584 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:57.612769 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:31:58.100137 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b8b1902d-7241-4595-87b0-d98530bbf1bf req-a046d006-c937-40fb-8d8c-57ae309b85cd service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-deleted-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:58.103421 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-b8b1902d-7241-4595-87b0-d98530bbf1bf req-a046d006-c937-40fb-8d8c-57ae309b85cd service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Neutron deleted interface 79dabe34-8df1-4974-80a9-d3eefc10ddac; detaching it from the instance and deleting it from the info cache
May 13 04:31:58.103576 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b8b1902d-7241-4595-87b0-d98530bbf1bf req-a046d006-c937-40fb-8d8c-57ae309b85cd service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:31:58.370699 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:31:58.370895 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] Acquiring lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:58.371078 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:58.371231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:31:58.371427 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] No waiting events found dispatching network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:31:58.371628 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6c0e766d-5adf-4231-b1c7-6c3881853831 req-d7a000c9-9d3f-49ba-b6c6-225745252a01 service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Received event network-vif-unplugged-79dabe34-8df1-4974-80a9-d3eefc10ddac for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:31:58.529372 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:31:58.606592 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b8b1902d-7241-4595-87b0-d98530bbf1bf req-a046d006-c937-40fb-8d8c-57ae309b85cd service nova] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Detach interface failed, port_id=79dabe34-8df1-4974-80a9-d3eefc10ddac, reason: Instance 1193eae6-8a0e-43f7-a572-077d3253a0ce could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:31:59.031610 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Took 1.52 seconds to deallocate network for instance.
May 13 04:31:59.536704 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:31:59.537113 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:31:59.662095 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:31:59.662318 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:32:00.164656 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:32:00.525672 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:00.672386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.135s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:00.718591 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Deleted allocations for instance 1193eae6-8a0e-43f7-a572-077d3253a0ce
May 13 04:32:01.726657 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-18ce17a8-3e1f-48ae-91df-345f07a6f202 tempest-TestServerVolumeAttachmentScenario-1954786639 tempest-TestServerVolumeAttachmentScenario-1954786639-project-member] Lock "1193eae6-8a0e-43f7-a572-077d3253a0ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.098s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:02.003229 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:05.524990 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:05.867605 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:07.006425 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:07.551066 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:11.485620 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003608560000429861 future=<Future at 0x7a463c715be0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:32:11.486139 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Emitting event <LifecycleEvent: 1778646716.4851496, 1193eae6-8a0e-43f7-a572-077d3253a0ce => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:32:11.486258 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:32:11.486409 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] VM Stopped (Lifecycle Event)
May 13 04:32:11.989133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: 1193eae6-8a0e-43f7-a572-077d3253a0ce] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:32:12.004264 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:14.586709 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:14.587140 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:15.090011 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:15.526994 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:16.094777 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:17.005544 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:17.264340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:17.264856 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:17.264856 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attaching volume c56650a9-2eeb-48e1-9103-edbc979833e0 to /dev/vdb
May 13 04:32:17.300199 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:17.310962 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:32:17.332142 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:17.380605 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:32:17.380884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:32:17.389120 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:32:17.390042 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7'] 
May 13 04:32:17.390134 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:32:17.390276 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:32:17.390471 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:17.390715 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating existing volume attachment record: 582bffbd-14c3-4717-b71a-c3a4c313c620 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:32:17.938124 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:32:17.938851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:17.938851 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:17.939101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:17.939287 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:32:17.952099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:17.953445 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:17.953912 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:17.954078 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:17.954440 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:17.954625 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:17.965731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:17.965731 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:17.966839 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:17.966839 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:17.976555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0] added
May 13 04:32:17.976555 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:17.976555 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:17.976555 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:17.976555 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:17.976555 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:17.976555 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:17.976865 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:17.976926 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:17.977069 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:17.980314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0] added
May 13 04:32:17.980314 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:17.980314 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:17.980314 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:17.980314 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:17.980314 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:17.980314 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:17.980498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:17.980678 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:17.980833 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:18.977514 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:18.981310 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:18.988396 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:18.988396 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:18.994094 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:18.994094 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:18.999844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:19.004146 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:19.012825 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.012825 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:19.013026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.013026 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:19.018268 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.018268 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:19.018446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.018446 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:19.042509 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.40.100,3260]
May 13 04:32:19.042509 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.40.100,3260] successful.
May 13 04:32:19.042509 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:19.053216 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:19.064021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.064021 np0000000669 nova-compute[97951]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:19.064021 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:19.064174 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:19.064174 np0000000669 nova-compute[97951]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:19.064174 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:19.064383 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:19.064496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:19.064969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('8', '-', '-', 0) found on session 209 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:19.065070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:19.077144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 209 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:19.077144 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:20.063643 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.50.100,3260]
May 13 04:32:20.063643 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.50.100,3260] successful.
May 13 04:32:20.063643 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:20.073654 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:20.085518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:20.085518 np0000000669 nova-compute[97951]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:20.085518 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:20.085518 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:20.085684 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:20.085684 np0000000669 nova-compute[97951]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:20.085684 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:20.085684 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:20.085871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.131s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:20.085966 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:20.086444 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('9', '-', '-', 0) found on session 210 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:20.086548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:20.099198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 210 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:20.099198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:21.001272 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found WWN 33000000075cafa83 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:32:21.001602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.062s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:21.001741 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== connect_volume: return (3063ms) {'type': 'block', 'scsi_wwn': '33000000075cafa83', 'path': '/dev/dm-0', 'multipath_id': '33000000075cafa83'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:21.001856 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000075cafa83', 'path': '/dev/dm-0', 'multipath_id': '33000000075cafa83'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:32:21.004689 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:21.507783 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to attach volume c56650a9-2eeb-48e1-9103-edbc979833e0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:32:21.509081 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:   <alias name="ua-c56650a9-2eeb-48e1-9103-edbc979833e0"/>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:   <serial>c56650a9-2eeb-48e1-9103-edbc979833e0</serial>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:21.509081 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:32:22.006641 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:23.139720 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:23.140111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:23.140111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:23.140111 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No VIF found with MAC fa:16:3e:90:f2:26, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:32:24.680058 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9114b6e1-192b-4405-8b05-400759eb9a30 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.415s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:25.040637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:25.040835 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:25.530376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:25.542857 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:32:26.088936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:26.089334 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:26.092423 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:32:26.092609 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Claim successful on node np0000000669
May 13 04:32:27.007849 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:27.253502 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:32:27.253996 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:32:27.756467 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:32:28.263064 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.174s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:28.263616 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:32:28.768902 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:32:28.769184 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:32:28.769516 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:28.769780 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:28.827748 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9ff05b2061e4098b95fb73a3d63f48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630d9a7e7c3743b4b76c00d727645d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:32:29.224663 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Successfully created port: c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:32:29.271852 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:32:29.669021 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Successfully updated port: c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:32:29.737122 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-changed-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:32:29.737334 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Refreshing instance network info cache due to event network-changed-c0c1fcf4-da71-48c7-942a-d1397d950829. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:32:29.737552 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] Acquiring lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:32:29.737985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] Acquired lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:32:29.738123 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Refreshing network info cache for port c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:32:30.171084 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:32:30.239852 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:30.277390 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:32:30.294778 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:32:30.406731 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:32:30.537961 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:30.781670 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Booting with volume 46dbb19a-8683-405f-8f7f-c5045a41bc33 at /dev/vdb
May 13 04:32:30.812934 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:30.822103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:32:30.842390 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:30.883942 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:32:30.884189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:32:30.893500 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:32:30.894354 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7'] 
May 13 04:32:30.894443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:32:30.894562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:32:30.894763 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:30.894964 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating existing volume attachment record: 4c727f49-67b5-46f2-bcbc-bf07812b68d8 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:32:30.908764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-b81e5142-62e2-4297-82d7-42643c04a92a req-c1606725-6075-4715-8bc5-f10fc021fc79 service nova] Releasing lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:32:30.909534 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquired lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:32:30.909534 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:32:31.079087 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:31.079641 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:32:31.468672 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:32:31.614544 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:31.727296 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating instance_info_cache with network_info: [{"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:32:32.008202 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:32.229104 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Releasing lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:32:32.229453 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance network_info: |[{"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:32:32.982593 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:32:32.983639 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:32:32.983849 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Creating image(s)
May 13 04:32:32.984293 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:32.984478 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:32.984936 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:32.985458 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:32:32.989039 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:32:32.990030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:33.075340 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:33.075747 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:33.076218 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:33.076661 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:32:33.079242 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:32:33.079553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:33.091213 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:33.092898 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:32:33.169503 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:33.169913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:33.224700 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk 1073741824" returned: 0 in 0.054s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:33.225153 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:33.225472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:33.312311 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:33.312722 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:32:33.312934 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:33.394899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:33.395263 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Cannot resize image /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:32:33.395659 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:32:33.395819 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Ensure instance console log exists: /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:32:33.396441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:33.396441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:33.396441 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:33.398498 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Start _get_guest_xml network_info=[{"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '16e291b7-d484-4efd-98c2-506d235406ef', 'attached_at': '', 'detached_at': '', 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'serial': '46dbb19a-8683-405f-8f7f-c5045a41bc33'}, 'disk_bus': 'virtio', 'attachment_id': '4c727f49-67b5-46f2-bcbc-bf07812b68d8', 'boot_index': -1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:32:33.405733 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:32:33.406852 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-instance-1748997153', uuid='16e291b7-d484-4efd-98c2-506d235406ef'), owner=OwnerMeta(userid='a9ff05b2061e4098b95fb73a3d63f48c', username='tempest-VolumesBackupsTest-590246420-project-member', projectid='630d9a7e7c3743b4b76c00d727645d4d', projectname='tempest-VolumesBackupsTest-590246420'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646753.4065442) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:32:33.407879 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:32:33.408237 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:32:33.409076 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:32:33.409271 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:32:33.410143 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:32:33.410439 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:32:33.410650 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:32:33.410789 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:32:33.410843 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:32:33.410922 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:32:33.411018 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:32:33.411163 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:32:33.411424 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:32:33.411534 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:32:33.411621 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:32:33.411728 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:32:33.421682 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:32:33.421732 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:33.422096 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:33.422158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:33.422342 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:32:33.434469 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:33.434891 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:33.435083 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:33.435489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:33.436871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:33.436871 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:33.445716 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:33.445716 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:33.450212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:33.450212 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:33.457492 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33] added
May 13 04:32:33.457492 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:33.457492 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:33.457492 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:33.457492 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:33.457492 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:33.457492 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:33.457737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:33.457893 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:33.458066 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:33.462197 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33] added
May 13 04:32:33.462197 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:33.462197 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:33.462197 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:33.462197 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:33.462197 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:33.462197 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:33.462410 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:33.462464 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:33.462587 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:33.904592 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:33.904592 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:34.407116 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Detaching volume c56650a9-2eeb-48e1-9103-edbc979833e0
May 13 04:32:34.444281 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to driver detach volume c56650a9-2eeb-48e1-9103-edbc979833e0 from mountpoint /dev/vdb
May 13 04:32:34.449008 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-c56650a9-2eeb-48e1-9103-edbc979833e0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:32:34.450202 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-c56650a9-2eeb-48e1-9103-edbc979833e0 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:32:34.450310 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Attempting to detach device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:32:34.450530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <alias name="ua-c56650a9-2eeb-48e1-9103-edbc979833e0"/>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <serial>c56650a9-2eeb-48e1-9103-edbc979833e0</serial>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:34.450530 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:32:34.456209 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config.
May 13 04:32:34.456384 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] (1/8): Attempting to detach device vdb with device alias ua-c56650a9-2eeb-48e1-9103-edbc979833e0 from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:32:34.456678 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <alias name="ua-c56650a9-2eeb-48e1-9103-edbc979833e0"/>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <serial>c56650a9-2eeb-48e1-9103-edbc979833e0</serial>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:34.456678 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:32:34.458519 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:34.462964 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:34.470097 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:34.470097 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:34.475192 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:34.475192 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.481371 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.487673 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.493359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.493359 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.493359 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:34.493359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.493359 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.493359 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:34.499597 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.499597 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.499597 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:34.499719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.499719 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.499719 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:34.526437 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.40.100,3260]
May 13 04:32:34.526437 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.40.100,3260] successful.
May 13 04:32:34.526437 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.537574 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.544160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.50.100,3260]
May 13 04:32:34.544160 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.50.100,3260] successful.
May 13 04:32:34.544160 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.549827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.549827 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.549827 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.549827 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.549827 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:34.549976 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.549976 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.549976 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.549976 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.549976 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:34.550156 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:34.550252 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:34.550970 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] HCTL ('7', '-', '-', 0) found on session 211 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:34.551095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:34.555370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:34.565725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Searching for a device in session 211 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:34.565725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:34.572164 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.572164 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.572164 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.572164 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.572164 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:34.572292 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.572292 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:34.572292 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.572292 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:34.572292 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:34.572513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:34.572619 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:34.573103 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] HCTL ('10', '-', '-', 0) found on session 212 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:34.573764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:34.589655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Searching for a device in session 212 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:34.589655 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:34.903630 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646754.903284, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => ua-c56650a9-2eeb-48e1-9103-edbc979833e0> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:32:34.904736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c56650a9-2eeb-48e1-9103-edbc979833e0 for instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:32:34.906948 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config.
May 13 04:32:34.907893 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:32:34.908171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:34.908339 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:35.084442 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:35.084698 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:35.437304 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:32:35.539768 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:35.589383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:35.589383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:35.589383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:35.589383 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:32:36.451666 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Found WWN 3300000006445482c for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:32:36.452064 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:36.452142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000006445482c', 'path': '/dev/dm-1', 'multipath_id': '3300000006445482c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:36.452301 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006445482c', 'path': '/dev/dm-1', 'multipath_id': '3300000006445482c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:32:36.452543 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.544s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:36.452850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c56650a9-2eeb-48e1-9103-edbc979833e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:32:36.452978 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:32:36.474544 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:36.474544 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:36.474544 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:36.474544 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:36.474544 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:36.474776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:36.474776 np0000000669 nova-compute[97951]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0 (non-flash)
May 13 04:32:36.474776 np0000000669 nova-compute[97951]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:36.474776 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:36.474776 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:36.474903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '212')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:32:36.474964 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', '209')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:32:36.475717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0', '210')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:32:36.476373 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c12f6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:32:36.476561 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:32:36.476788 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flush multipath device 33000000075cafa83 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:32:36.508514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:32:36.550514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:32:36.594571 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:32:36.594701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:32:36.595388 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:32:36.605438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:32:36.605567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:32:36.611633 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:36.623884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.650187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.40.100,3260]
May 13 04:32:36.650187 np0000000669 nova-compute[97951]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.40.100,3260] successful.
May 13 04:32:36.650187 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.664499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.675012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.703343 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.50.100,3260]
May 13 04:32:36.703343 np0000000669 nova-compute[97951]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-c56650a9-2eeb-48e1-9103-edbc979833e0, portal: 192.168.50.100,3260] successful.
May 13 04:32:36.703343 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.704924 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:36.705383 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:36.717219 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:36.718158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:36.718384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== disconnect_volume: return (1809ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:36.718666 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:32:36.789774 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:36.793933 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:32:36.794916 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:36.838264 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:36.838685 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13902MB free_disk=72.66077041625977GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:32:36.838888 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:36.839175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:36.957839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1748997153',display_name='tempest-instance-1748997153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-instance-1748997153',id=78,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8h+HFI76oi9lRy80SUhe+Q8Jysf7wrP5/U1vmCHxfwUIYV3agbKrHAxYJfxyzfZHTYnkZ22TBZhFr7B/4gn7h6ocQLfTcGo73XDlqX42wg3lNAZ2rMX9vxToFXzsnKRQ==',key_name='tempest-keypair-1117809962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='630d9a7e7c3743b4b76c00d727645d4d',ramdisk_id='',reservation_id='r-p7nefi6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-590246420',owner_user_name='tempest-VolumesBackupsTest-590246420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9ff05b2061e4098b95fb73a3d63f48c',uuid=16e291b7-d484-4efd-98c2-506d235406ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:32:36.958168 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converting VIF {"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:32:36.958941 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:32:36.959872 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lazy-loading 'pci_devices' on Instance uuid 16e291b7-d484-4efd-98c2-506d235406ef {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:37.009342 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.267377 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:37.462936 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] End _get_guest_xml xml=<domain type="qemu">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <uuid>16e291b7-d484-4efd-98c2-506d235406ef</uuid>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <name>instance-0000004e</name>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:name>tempest-instance-1748997153</nova:name>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:32:33</nova:creationTime>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:user uuid="a9ff05b2061e4098b95fb73a3d63f48c">tempest-VolumesBackupsTest-590246420-project-member</nova:user>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:project uuid="630d9a7e7c3743b4b76c00d727645d4d">tempest-VolumesBackupsTest-590246420</nova:project>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         <nova:port uuid="c0c1fcf4-da71-48c7-942a-d1397d950829">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <system>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="serial">16e291b7-d484-4efd-98c2-506d235406ef</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="uuid">16e291b7-d484-4efd-98c2-506d235406ef</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </system>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <os>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </os>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <features>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </features>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   <devices>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </disk>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.config"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </disk>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <disk type="block" device="disk">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <alias name="ua-46dbb19a-8683-405f-8f7f-c5045a41bc33"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <source dev="/dev/dm-1"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <target dev="vdb" bus="virtio"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <serial>46dbb19a-8683-405f-8f7f-c5045a41bc33</serial>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </disk>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:bd:1b:0d"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <target dev="tapc0c1fcf4-da"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </interface>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/console.log" append="off"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </serial>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <video>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </video>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </rng>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:   </devices>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]: </domain>
May 13 04:32:37.462936 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Preparing to wait for external event network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1748997153',display_name='tempest-instance-1748997153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-instance-1748997153',id=78,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8h+HFI76oi9lRy80SUhe+Q8Jysf7wrP5/U1vmCHxfwUIYV3agbKrHAxYJfxyzfZHTYnkZ22TBZhFr7B/4gn7h6ocQLfTcGo73XDlqX42wg3lNAZ2rMX9vxToFXzsnKRQ==',key_name='tempest-keypair-1117809962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='630d9a7e7c3743b4b76c00d727645d4d',ramdisk_id='',reservation_id='r-p7nefi6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-590246420',owner_user_name='tempest-VolumesBackupsTest-590246420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9ff05b2061e4098b95fb73a3d63f48c',uuid=16e291b7-d484-4efd-98c2-506d235406ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converting VIF {"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:32:37.465314 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:32:37.465657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.465808 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:32:37.466130 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:32:37.467283 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.467512 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f92b452a-5488-5305-b1ac-b9b95bd7589a', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:32:37.468518 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.469620 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:32:37.471207 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.471358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0c1fcf4-da, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:32:37.471675 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0c1fcf4-da, col_values=(('qos', UUID('a677f65a-d211-4c43-a416-075b28fb03ca')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:32:37.471834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0c1fcf4-da, col_values=(('external_ids', {'iface-id': 'c0c1fcf4-da71-48c7-942a-d1397d950829', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:1b:0d', 'vm-uuid': '16e291b7-d484-4efd-98c2-506d235406ef'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:32:37.473697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:32:37.477187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:37.478020 np0000000669 nova-compute[97951]: INFO os_vif [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da')
May 13 04:32:37.889124 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:32:37.889207 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 16e291b7-d484-4efd-98c2-506d235406ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:32:37.889383 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:32:37.889518 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:32:36 up 46 min,  2 users,  load average: 2.41, 4.24, 4.63\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_8598c291629242869fa2a040db124338': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_630d9a7e7c3743b4b76c00d727645d4d': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:32:38.007701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:32:38.007916 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:32:38.272269 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-da3541c0-8c78-4833-948f-ab9b2ec86be6 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.368s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:38.510531 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:32:38.993059 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:38.993211 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:38.993330 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:38.993519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] No VIF found with MAC fa:16:3e:bd:1b:0d, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:32:38.994055 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Using config drive
May 13 04:32:39.018405 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:32:39.018553 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.179s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:39.018819 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:32:39.499277 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:39.596371 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Creating config drive at /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.config
May 13 04:32:39.599973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm5k5mkvm {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:39.652368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm5k5mkvm" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:32:40.017840 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:40.018064 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:40.018239 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:40.018511 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.06 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:32:40.033659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.054623 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.146978 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.223255 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-14ff4b7e-7132-4306-a251-8ae81695a727 req-89fb112e-271e-43ba-b865-5efc6a86a291 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:32:40.227785 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-14ff4b7e-7132-4306-a251-8ae81695a727 req-89fb112e-271e-43ba-b865-5efc6a86a291 service nova] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:40.228077 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-14ff4b7e-7132-4306-a251-8ae81695a727 req-89fb112e-271e-43ba-b865-5efc6a86a291 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:40.228250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-14ff4b7e-7132-4306-a251-8ae81695a727 req-89fb112e-271e-43ba-b865-5efc6a86a291 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:40.228660 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-14ff4b7e-7132-4306-a251-8ae81695a727 req-89fb112e-271e-43ba-b865-5efc6a86a291 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Processing event network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:32:40.319000 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:40.319363 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:40.325148 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.327157 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.328777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.344252 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.541944 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:40.750584 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646760.7501607, 16e291b7-d484-4efd-98c2-506d235406ef => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:32:40.750968 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:32:40.751107 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] VM Started (Lifecycle Event)
May 13 04:32:40.752966 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:32:40.755455 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance spawned successfully.
May 13 04:32:40.756346 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:32:40.822619 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:41.253570 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:32:41.255610 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:32:41.263467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.263604 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.263921 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.264157 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.264443 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.264688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:32:41.759276 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:32:41.759702 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646761.759385, 16e291b7-d484-4efd-98c2-506d235406ef => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:32:41.759702 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] VM Paused (Lifecycle Event)
May 13 04:32:41.770662 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Took 8.79 seconds to spawn the instance on the hypervisor.
May 13 04:32:41.770803 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:32:41.826804 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:42.083650 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:32:42.083800 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:32:42.084020 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:32:42.262277 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:32:42.265880 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646762.2655668, 16e291b7-d484-4efd-98c2-506d235406ef => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:32:42.266027 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] VM Resumed (Lifecycle Event)
May 13 04:32:42.274189 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:32:42.274690 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:42.274862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:42.274983 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:42.275103 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] No waiting events found dispatching network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:32:42.277318 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-204ae97a-20d2-487f-b1e5-0f2b70f91ced req-8a38c41b-89b1-4028-866d-93b684ee77a1 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received unexpected event network-vif-plugged-c0c1fcf4-da71-48c7-942a-d1397d950829 for instance with vm_state active and task_state None.
May 13 04:32:42.280789 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Took 16.23 seconds to build instance.
May 13 04:32:42.473171 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:42.768594 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:32:42.770411 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:32:42.782278 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-244d504e-287d-48e9-942f-ecde501eecda tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.741s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:42.881707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:42.881886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:42.882140 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attaching volume 67f406e8-a12b-40d2-8941-911229978c68 to /dev/vdb
May 13 04:32:42.936198 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:42.948780 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:32:42.969230 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:32:43.011868 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:32:43.012122 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:32:43.020192 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:32:43.021363 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7', 'fe80::fc16:3eff:febd:1b0d', 'fe80::70f2:bfff:fe51:1c45'] 
May 13 04:32:43.021363 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:32:43.021363 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:32:43.021517 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:43.021728 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating existing volume attachment record: 883227a3-86ab-4e78-9f7f-df0eb2756f8d {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:32:43.570274 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:32:43.570274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:43.570274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:43.570646 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:43.570929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:32:43.584686 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:43.585452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:43.585846 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:43.586036 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:43.588684 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:43.588684 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:43.595925 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:43.595925 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:43.603005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:32:43.603005 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:43.608913 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68] added
May 13 04:32:43.608913 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:43.608913 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:43.608913 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:43.608913 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:43.608913 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:43.608913 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:43.609089 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:43.609259 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:43.609417 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:43.612266 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68] added
May 13 04:32:43.612266 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:32:43.612266 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:43.612266 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:43.612266 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:32:43.612266 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:32:43.612266 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:43.612445 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:32:43.612553 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:32:43.612678 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:32:43.616919 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-changed-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:32:43.617058 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Refreshing instance network info cache due to event network-changed-c0c1fcf4-da71-48c7-942a-d1397d950829. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:32:43.617214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] Acquiring lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:32:43.617380 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] Acquired lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:32:43.617423 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Refreshing network info cache for port c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:32:44.119778 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:44.388139 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:32:44.501694 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updated VIF entry in instance network info cache for port c0c1fcf4-da71-48c7-942a-d1397d950829. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:32:44.502010 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating instance_info_cache with network_info: [{"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:32:44.610047 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:32:44.613108 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:44.622421 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:44.622421 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:32:44.629043 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:32:44.629043 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.638689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.643513 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.651927 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.651927 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.651927 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:44.652098 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.652098 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.652098 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:44.658550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.658550 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.658550 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:44.658749 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.658749 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.658749 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:44.680806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.40.100,3260]
May 13 04:32:44.680806 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.40.100,3260] successful.
May 13 04:32:44.680806 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.694360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.703930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.50.100,3260]
May 13 04:32:44.703930 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.50.100,3260] successful.
May 13 04:32:44.703930 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.709541 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.709541 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.709541 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.709541 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.709541 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:44.709798 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.709798 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.709798 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.709798 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.709798 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:44.709987 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:44.710189 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:44.710896 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('8', '-', '-', 0) found on session 213 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:44.711005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:44.716709 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:44.724659 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 213 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:44.724880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:44.732602 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:44.733162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:44.733162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:32:44.733358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('9', '-', '-', 0) found on session 214 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:32:44.733490 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:32:44.747922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 214 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:32:44.747922 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:32:45.004093 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-10962786-952a-45b5-889e-7f4757f5e6df req-f1c50560-0803-4f96-bba2-42c79afbd08d service nova] Releasing lock "refresh_cache-16e291b7-d484-4efd-98c2-506d235406ef" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:32:45.543754 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:45.586168 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:32:46.601483 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found WWN 3300000007949184a for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:32:46.601990 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:46.602052 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000007949184a', 'path': '/dev/dm-0', 'multipath_id': '3300000007949184a'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:46.602233 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007949184a', 'path': '/dev/dm-0', 'multipath_id': '3300000007949184a'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:32:46.605498 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:47.108830 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to attach volume 67f406e8-a12b-40d2-8941-911229978c68 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:32:47.110343 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:   <alias name="ua-67f406e8-a12b-40d2-8941-911229978c68"/>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:   <serial>67f406e8-a12b-40d2-8941-911229978c68</serial>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:47.110343 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:32:47.475660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:48.751170 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:48.751707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:48.751707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:32:48.751707 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No VIF found with MAC fa:16:3e:90:f2:26, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:32:50.298168 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e7e73285-f2bb-46e9-9101-8f51d04c4542 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.416s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:50.545580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:52.476936 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:53.885132 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:53.885594 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:54.387701 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Detaching volume 67f406e8-a12b-40d2-8941-911229978c68
May 13 04:32:54.427993 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to driver detach volume 67f406e8-a12b-40d2-8941-911229978c68 from mountpoint /dev/vdb
May 13 04:32:54.436612 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-67f406e8-a12b-40d2-8941-911229978c68 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:32:54.437786 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-67f406e8-a12b-40d2-8941-911229978c68 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:32:54.437887 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Attempting to detach device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:32:54.438093 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <alias name="ua-67f406e8-a12b-40d2-8941-911229978c68"/>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <serial>67f406e8-a12b-40d2-8941-911229978c68</serial>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:54.438093 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:32:54.444239 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config.
May 13 04:32:54.444417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] (1/8): Attempting to detach device vdb with device alias ua-67f406e8-a12b-40d2-8941-911229978c68 from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:32:54.444650 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <alias name="ua-67f406e8-a12b-40d2-8941-911229978c68"/>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <serial>67f406e8-a12b-40d2-8941-911229978c68</serial>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]: </disk>
May 13 04:32:54.444650 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:32:54.946350 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646774.945987, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => ua-67f406e8-a12b-40d2-8941-911229978c68> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:32:54.947532 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-67f406e8-a12b-40d2-8941-911229978c68 for instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:32:54.950191 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config.
May 13 04:32:54.951430 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:32:54.951729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:32:54.951831 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:32:54.952269 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:32:54.952657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67f406e8-a12b-40d2-8941-911229978c68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:32:54.952776 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:32:54.976692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:54.976692 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:54.976692 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:54.976692 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:54.976692 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:32:54.976908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:54.976908 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:32:54.976908 np0000000669 nova-compute[97951]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:54.976908 np0000000669 nova-compute[97951]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68 (non-flash)
May 13 04:32:54.976908 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:32:54.976997 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', '214')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:32:54.977202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', '213')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:32:54.978114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68', '214')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:32:54.978935 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46482144a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:32:54.979142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:32:54.979519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flush multipath device 3300000007949184a {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:32:55.016765 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:32:55.068832 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:32:55.110689 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:32:55.110854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:32:55.111519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:32:55.123973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:32:55.124177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:32:55.135303 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.172244 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.40.100,3260]
May 13 04:32:55.172244 np0000000669 nova-compute[97951]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.40.100,3260] successful.
May 13 04:32:55.172244 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.185012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.196269 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.224249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.50.100,3260]
May 13 04:32:55.224249 np0000000669 nova-compute[97951]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-67f406e8-a12b-40d2-8941-911229978c68, portal: 192.168.50.100,3260] successful.
May 13 04:32:55.224249 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.236711 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:32:55.236949 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:32:55.237076 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== disconnect_volume: return (285ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:32:55.237215 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:32:55.546601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:55.785174 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:56.789898 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e3a88f15-fd60-4923-ad1f-f6eb99c3cd43 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.904s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:32:57.477757 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:32:58.245427 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:32:58.245931 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:32:58.749274 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:32:59.754496 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:00.547272 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:00.816108 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:00.816498 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:00.816498 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attaching volume 10baecab-1561-4999-b700-908e1e2e36af to /dev/vdb
May 13 04:33:00.850403 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:00.860029 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:33:00.880448 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:33:00.931953 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:33:00.932262 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:33:00.940854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:33:00.941858 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7', 'fe80::fc16:3eff:febd:1b0d', 'fe80::70f2:bfff:fe51:1c45'] 
May 13 04:33:00.942004 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:33:00.942127 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:33:00.942412 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:00.942676 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating existing volume attachment record: d2e77b6c-dd52-4eac-9fca-70831c5c6d9d {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:33:01.489216 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:33:01.489578 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:01.489755 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:01.490190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:01.490449 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:33:01.502201 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:01.502878 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:01.503438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:01.503678 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:33:01.504173 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:01.504440 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:33:01.514866 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:33:01.514866 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:01.519566 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:33:01.519566 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:01.527902 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af] added
May 13 04:33:01.527902 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:33:01.527902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:01.527902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:01.527902 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:01.527902 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:01.527902 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:01.528153 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:33:01.528230 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:33:01.528377 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:33:01.531162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af] added
May 13 04:33:01.531162 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:33:01.531162 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:01.531162 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:01.531162 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:01.531162 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:01.531162 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:01.531366 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:33:01.531480 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:33:01.531611 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:33:02.478856 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:02.528834 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:33:02.532153 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:33:02.539812 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:33:02.539812 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:33:02.545214 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:33:02.545214 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.551480 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.557622 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.565017 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.565017 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.565017 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:02.565171 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.565171 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.565171 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:02.569759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.569759 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.569759 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:02.570202 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.570202 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.570202 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:02.594337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.40.100,3260]
May 13 04:33:02.594337 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.40.100,3260] successful.
May 13 04:33:02.594337 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.599928 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.50.100,3260]
May 13 04:33:02.599928 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.50.100,3260] successful.
May 13 04:33:02.599928 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.604824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.611721 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:02.618934 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.618934 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.618934 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.618934 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.618934 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:02.619102 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.619102 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.619102 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.619102 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.619102 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:02.619293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:02.619414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:33:02.619986 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('8', '-', '-', 0) found on session 215 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:33:02.620080 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:33:02.625705 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.625705 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.625705 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.625705 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.625705 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:02.625822 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.625822 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:02.625822 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.625822 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:02.625822 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:02.626041 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:02.626163 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:33:02.626787 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('9', '-', '-', 0) found on session 216 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:33:02.626895 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:33:02.635481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 215 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:33:02.635481 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:33:02.642034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 216 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:33:02.642034 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:33:03.503792 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:33:04.518124 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found WWN 330000000486d170c for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:33:04.518640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:04.518640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '330000000486d170c', 'path': '/dev/dm-0', 'multipath_id': '330000000486d170c'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:04.518716 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000486d170c', 'path': '/dev/dm-0', 'multipath_id': '330000000486d170c'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:33:04.521490 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:05.024968 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to attach volume 10baecab-1561-4999-b700-908e1e2e36af with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:33:05.026768 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:   <alias name="ua-10baecab-1561-4999-b700-908e1e2e36af"/>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:   <serial>10baecab-1561-4999-b700-908e1e2e36af</serial>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:05.026768 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:33:05.547900 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:06.659776 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:06.660366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:06.660366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:06.660366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No VIF found with MAC fa:16:3e:90:f2:26, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:33:07.480439 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:08.208277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-d79414ac-a165-4b2b-9a97-4862fe7ba935 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.392s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:10.560847 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:11.398793 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:11.399352 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:11.901540 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Detaching volume 10baecab-1561-4999-b700-908e1e2e36af
May 13 04:33:11.933349 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to driver detach volume 10baecab-1561-4999-b700-908e1e2e36af from mountpoint /dev/vdb
May 13 04:33:11.937301 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-10baecab-1561-4999-b700-908e1e2e36af {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:33:11.938377 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-10baecab-1561-4999-b700-908e1e2e36af {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:33:11.938377 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Attempting to detach device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:33:11.938377 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <alias name="ua-10baecab-1561-4999-b700-908e1e2e36af"/>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <serial>10baecab-1561-4999-b700-908e1e2e36af</serial>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:11.938377 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:33:11.943724 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config.
May 13 04:33:11.943840 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] (1/8): Attempting to detach device vdb with device alias ua-10baecab-1561-4999-b700-908e1e2e36af from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:33:11.944063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <alias name="ua-10baecab-1561-4999-b700-908e1e2e36af"/>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <serial>10baecab-1561-4999-b700-908e1e2e36af</serial>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:11.944063 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:33:12.394981 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646792.3945749, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => ua-10baecab-1561-4999-b700-908e1e2e36af> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:33:12.396358 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-10baecab-1561-4999-b700-908e1e2e36af for instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:33:12.398430 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config.
May 13 04:33:12.399363 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:33:12.399636 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:12.399850 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:12.400068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:12.400300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10baecab-1561-4999-b700-908e1e2e36af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:33:12.400433 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:33:12.424814 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:12.424814 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:12.424814 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:12.424814 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:12.424814 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:12.425015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:12.425015 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:12.425015 np0000000669 nova-compute[97951]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:12.425015 np0000000669 nova-compute[97951]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af (non-flash)
May 13 04:33:12.425015 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:12.425162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', '216')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:33:12.425162 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', '215')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:12.426128 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af', '216')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:12.426817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c71b9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:33:12.426995 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:33:12.427212 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flush multipath device 330000000486d170c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:33:12.462190 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:12.481825 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:12.507903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:12.560015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:33:12.560367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:33:12.561100 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:33:12.573677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:33:12.573900 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:33:12.585685 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.612910 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.40.100,3260]
May 13 04:33:12.612910 np0000000669 nova-compute[97951]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.40.100,3260] successful.
May 13 04:33:12.612910 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.625675 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.635557 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.661083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.50.100,3260]
May 13 04:33:12.661083 np0000000669 nova-compute[97951]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-10baecab-1561-4999-b700-908e1e2e36af, portal: 192.168.50.100,3260] successful.
May 13 04:33:12.661083 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.672316 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:12.672555 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:12.672609 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== disconnect_volume: return (273ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:12.672724 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:33:13.210706 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:14.216876 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7eebba58-6b52-4464-b942-d62361d66aa2 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.818s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:15.575371 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:15.740216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:15.740533 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:16.243187 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:17.247398 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:17.483063 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:18.299485 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:18.299946 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:18.299946 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attaching volume d6b0b18e-0241-4141-a3e2-08c2837b9a32 to /dev/vdb
May 13 04:33:18.329947 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:18.339401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:33:18.358716 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:33:18.402319 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:33:18.402565 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:33:18.409982 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:33:18.410981 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe90:f226', 'fe80::a8b8:52ff:feae:d4f7', 'fe80::fc16:3eff:febd:1b0d', 'fe80::70f2:bfff:fe51:1c45'] 
May 13 04:33:18.411082 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:33:18.411179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:33:18.411428 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:18.411686 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating existing volume attachment record: 4702d7b1-5a1c-4785-a7e5-fe13ca28ac2a {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:33:18.953553 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:33:18.953868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:18.954012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:18.954427 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:18.954601 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:33:18.965677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:18.966452 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:18.966914 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:18.967139 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:33:18.967540 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:18.967716 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:33:18.977663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:33:18.977663 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:18.981830 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:33:18.981830 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:18.988252 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32] added
May 13 04:33:18.988252 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:33:18.988252 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:18.988252 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:18.988252 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:18.988252 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:18.988252 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:18.988510 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:33:18.988690 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:33:18.988828 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32] added
May 13 04:33:18.992230 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:33:18.992230 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:33:18.992230 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:33:18.992507 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:33:19.989279 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:33:19.992908 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:33:19.999893 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:33:19.999893 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:33:20.004663 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:33:20.004663 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.010929 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.015442 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.021972 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.021972 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.021972 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:20.022088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.022088 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.022088 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:20.027143 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.027143 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.027143 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:20.027307 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.027307 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.027307 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:20.048284 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.40.100,3260]
May 13 04:33:20.048284 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.40.100,3260] successful.
May 13 04:33:20.048284 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.059829 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.065856 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.50.100,3260]
May 13 04:33:20.065856 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.50.100,3260] successful.
May 13 04:33:20.065856 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.072924 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.072924 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.072924 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.072924 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.072924 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:20.073138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.073138 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.073138 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.073138 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.073138 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:20.073234 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.106s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:20.073382 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:33:20.073946 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('8', '-', '-', 0) found on session 217 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:33:20.074048 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:33:20.078159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:20.086229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 217 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:33:20.086229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:33:20.090881 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.090881 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.090881 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.090881 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.090881 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:20.091019 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.091019 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:20.091019 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.091019 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:20.091019 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:20.091224 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:20.091336 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:33:20.091890 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] HCTL ('9', '-', '-', 0) found on session 218 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:33:20.091989 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:33:20.104518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Searching for a device in session 218 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:33:20.104706 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:33:20.114973 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:20.115557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:20.115557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:20.115557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:20.115557 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:20.118849 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Terminating instance
May 13 04:33:20.584657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.622059 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:33:20.635761 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.636969 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.653954 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.671697 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.754975 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:20.755338 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:20.755549 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:20.755643 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:20.755758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] No waiting events found dispatching network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:33:20.755866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1bcfccee-0240-40a2-8d9e-33107630539b req-e2beffa5-3482-41b0-84b9-bcd54f744df7 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:33:20.814097 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:20.940746 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999673382999845 future=<Future at 0x7a463c15e5a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:20.941193 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999172927000018 future=<Future at 0x7a463c15e5a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:20.941260 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999037130000033 future=<Future at 0x7a463c15e5a0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:20.942931 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Instance destroyed successfully.
May 13 04:33:20.943517 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lazy-loading 'resources' on Instance uuid 16e291b7-d484-4efd-98c2-506d235406ef {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:20.967074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:33:21.447147 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1748997153',display_name='tempest-instance-1748997153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-instance-1748997153',id=78,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8h+HFI76oi9lRy80SUhe+Q8Jysf7wrP5/U1vmCHxfwUIYV3agbKrHAxYJfxyzfZHTYnkZ22TBZhFr7B/4gn7h6ocQLfTcGo73XDlqX42wg3lNAZ2rMX9vxToFXzsnKRQ==',key_name='tempest-keypair-1117809962',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:32:41Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='630d9a7e7c3743b4b76c00d727645d4d',ramdisk_id='',reservation_id='r-p7nefi6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-590246420',owner_user_name='tempest-VolumesBackupsTest-590246420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9ff05b2061e4098b95fb73a3d63f48c',uuid=16e291b7-d484-4efd-98c2-506d235406ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:33:21.447792 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converting VIF {"id": "c0c1fcf4-da71-48c7-942a-d1397d950829", "address": "fa:16:3e:bd:1b:0d", "network": {"id": "77c642ec-1f04-4e2f-81d4-9a46d8a45acc", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-457034037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "630d9a7e7c3743b4b76c00d727645d4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c1fcf4-da", "ovs_interfaceid": "c0c1fcf4-da71-48c7-942a-d1397d950829", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:33:21.447997 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:33:21.448126 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:33:21.449455 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.449690 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0c1fcf4-da, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:33:21.450612 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.451263 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:33:21.451726 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.452076 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.452286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a677f65a-d211-4c43-a416-075b28fb03ca) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:33:21.452942 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.453345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:33:21.453757 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:21.455302 np0000000669 nova-compute[97951]: INFO os_vif [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1b:0d,bridge_name='br-int',has_traffic_filtering=True,id=c0c1fcf4-da71-48c7-942a-d1397d950829,network=Network(77c642ec-1f04-4e2f-81d4-9a46d8a45acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c1fcf4-da')
May 13 04:33:21.456701 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:33:21.456963 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:21.457071 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:21.982687 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found WWN 330000000bf3a353d for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:33:21.982882 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:21.983026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000bf3a353d', 'path': '/dev/dm-0', 'multipath_id': '330000000bf3a353d'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:21.983181 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf3a353d', 'path': '/dev/dm-0', 'multipath_id': '330000000bf3a353d'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:33:21.983726 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.526s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:21.984026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46dbb19a-8683-405f-8f7f-c5045a41bc33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:33:21.984138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:33:21.986351 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:22.007731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:22.007731 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:22.007731 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:22.007731 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:22.007731 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:22.008110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:22.008110 np0000000669 nova-compute[97951]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:22.008110 np0000000669 nova-compute[97951]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:22.008110 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:22.008110 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:22.008303 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '218')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:33:22.008508 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '211')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:22.009489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '212')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:22.010094 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a461c6522a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'): ({'sde'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:33:22.010348 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Removing multipathed devices sdb, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:33:22.010550 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Flush multipath device 3300000006445482c {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:33:22.065629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:22.117783 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:22.162781 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Checking to see if SCSI volumes sdb, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:33:22.162979 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] SCSI volumes sdb, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:33:22.163651 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Checking to see if device paths {'sdb', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:33:22.174447 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Device paths {'sdb', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:33:22.174663 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:33:22.185026 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.209977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.40.100,3260]
May 13 04:33:22.209977 np0000000669 nova-compute[97951]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.40.100,3260] successful.
May 13 04:33:22.209977 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.223380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.232928 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.259005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.50.100,3260]
May 13 04:33:22.259005 np0000000669 nova-compute[97951]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33, portal: 192.168.50.100,3260] successful.
May 13 04:33:22.259005 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.271136 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:22.271346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:22.271465 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] <== disconnect_volume: return (814ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:22.271588 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:33:22.271818 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Deleting instance files /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef_del
May 13 04:33:22.272345 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Deletion of /opt/stack/data/nova/instances/16e291b7-d484-4efd-98c2-506d235406ef_del complete
May 13 04:33:22.489137 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to attach volume d6b0b18e-0241-4141-a3e2-08c2837b9a32 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:33:22.490486 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:   <alias name="ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32"/>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:   <serial>d6b0b18e-0241-4141-a3e2-08c2837b9a32</serial>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:22.490486 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:33:22.778214 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Took 2.16 seconds to destroy the instance on the hypervisor.
May 13 04:33:22.778729 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:33:22.778905 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:33:22.779027 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:33:22.779243 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:33:22.825053 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:22.825230 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] Acquiring lock "16e291b7-d484-4efd-98c2-506d235406ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:22.825887 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:22.826021 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] Lock "16e291b7-d484-4efd-98c2-506d235406ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:22.826157 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] No waiting events found dispatching network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:33:22.826294 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d70425f4-1902-40dc-92ef-6b2e1edff6fe req-d1530d25-15d2-40e8-9815-2d073a1d0bf6 service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-unplugged-c0c1fcf4-da71-48c7-942a-d1397d950829 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:33:22.868585 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:33:23.251923 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80d5ae1f-5f95-40e7-99ea-e6cbe56af627 req-06547fcb-8e68-40e3-8d8e-ee1b32e62e3a service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Received event network-vif-deleted-c0c1fcf4-da71-48c7-942a-d1397d950829 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:23.252111 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-80d5ae1f-5f95-40e7-99ea-e6cbe56af627 req-06547fcb-8e68-40e3-8d8e-ee1b32e62e3a service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Neutron deleted interface c0c1fcf4-da71-48c7-942a-d1397d950829; detaching it from the instance and deleting it from the info cache
May 13 04:33:23.252205 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-80d5ae1f-5f95-40e7-99ea-e6cbe56af627 req-06547fcb-8e68-40e3-8d8e-ee1b32e62e3a service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:33:23.710023 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:33:23.757674 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-80d5ae1f-5f95-40e7-99ea-e6cbe56af627 req-06547fcb-8e68-40e3-8d8e-ee1b32e62e3a service nova] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Detach interface failed, port_id=c0c1fcf4-da71-48c7-942a-d1397d950829, reason: Instance 16e291b7-d484-4efd-98c2-506d235406ef could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:33:24.123736 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:24.123885 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:24.123926 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:33:24.124037 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] No VIF found with MAC fa:16:3e:90:f2:26, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:33:24.211937 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Took 1.43 seconds to deallocate network for instance.
May 13 04:33:24.749232 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Took 0.54 seconds to detach 1 volumes for instance.
May 13 04:33:25.253683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:25.253872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:25.380616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:33:25.380838 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:33:25.585840 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:25.667735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-b39474ad-7fb6-4f70-8f62-5728ea918a5a tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.368s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:25.883428 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:33:26.389520 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.135s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:26.429960 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Deleted allocations for instance 16e291b7-d484-4efd-98c2-506d235406ef
May 13 04:33:26.460985 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:27.437434 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-4cfb3a07-ba54-4ef3-9a13-cce89b736421 tempest-VolumesBackupsTest-590246420 tempest-VolumesBackupsTest-590246420-project-member] Lock "16e291b7-d484-4efd-98c2-506d235406ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.322s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:29.248339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:29.248339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:29.751028 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Detaching volume d6b0b18e-0241-4141-a3e2-08c2837b9a32
May 13 04:33:29.801742 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Attempting to driver detach volume d6b0b18e-0241-4141-a3e2-08c2837b9a32 from mountpoint /dev/vdb
May 13 04:33:29.806873 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:33:29.808062 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Found disk vdb by alias ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:33:29.808218 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Attempting to detach device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:33:29.808549 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <alias name="ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32"/>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <serial>d6b0b18e-0241-4141-a3e2-08c2837b9a32</serial>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:29.808549 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:33:29.813827 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the persistent domain config.
May 13 04:33:29.814024 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] (1/8): Attempting to detach device vdb with device alias ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32 from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:33:29.814348 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <alias name="ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32"/>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <serial>d6b0b18e-0241-4141-a3e2-08c2837b9a32</serial>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]: </disk>
May 13 04:33:29.814348 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:33:30.298514 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646810.2980886, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:33:30.299594 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d6b0b18e-0241-4141-a3e2-08c2837b9a32 for instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:33:30.302282 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully detached device vdb from instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 from the live domain config.
May 13 04:33:30.304020 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:33:30.304338 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:33:30.304459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:33:30.304752 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:33:30.305006 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b0b18e-0241-4141-a3e2-08c2837b9a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:33:30.305133 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:33:30.328862 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:30.328862 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:30.328862 np0000000669 nova-compute[97951]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:30.328862 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:33:30.329031 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:30.329031 np0000000669 nova-compute[97951]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32 (non-flash)
May 13 04:33:30.329031 np0000000669 nova-compute[97951]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33 (non-flash)
May 13 04:33:30.329031 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:33:30.329118 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46dbb19a-8683-405f-8f7f-c5045a41bc33', '219')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:33:30.329180 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '217')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:30.329928 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32', '218')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:33:30.330558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480f7c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:33:30.330747 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Removing multipathed devices sdc, sdd {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:33:30.330945 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Flush multipath device 330000000bf3a353d {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:33:30.360360 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:30.407779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:33:30.455785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:33:30.455914 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:33:30.456740 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:33:30.470903 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:33:30.471061 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:33:30.482572 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.506728 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.40.100,3260]
May 13 04:33:30.506728 np0000000669 nova-compute[97951]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.40.100,3260] successful.
May 13 04:33:30.506728 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.518346 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.528458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.552142 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.50.100,3260]
May 13 04:33:30.552142 np0000000669 nova-compute[97951]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-d6b0b18e-0241-4141-a3e2-08c2837b9a32, portal: 192.168.50.100,3260] successful.
May 13 04:33:30.552142 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.563559 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:33:30.563761 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:33:30.563873 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] <== disconnect_volume: return (259ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:33:30.563984 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:33:30.588074 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:31.103503 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'flavor' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:31.463012 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:32.109863 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-0089d85f-be33-4a3f-a97e-324fed8226cf tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.862s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:33.079122 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:33.079597 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:35.083792 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:35.084265 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:35.589378 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:35.589531 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:35.589637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:35.589762 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:33:35.940731 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003935149998142151 future=<Future at 0x7a463c15e5a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:35.941094 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] Emitting event <LifecycleEvent: 1778646800.9402475, 16e291b7-d484-4efd-98c2-506d235406ef => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:33:35.941213 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:35.941367 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] VM Stopped (Lifecycle Event)
May 13 04:33:36.443886 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-efc8c958-3411-4da1-bfc1-cc28abc2f2e2 tempest-TestVolumeBootPattern-722735240 tempest-TestVolumeBootPattern-722735240-project-member] [instance: 16e291b7-d484-4efd-98c2-506d235406ef] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:33:36.464532 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:36.611160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:33:36.693514 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:33:36.693951 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:33:36.776346 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:33:36.780480 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:33:36.781673 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:33:36.823961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:33:36.824384 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=13676MB free_disk=72.65614318847656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:33:36.824606 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:36.824878 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:37.874315 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:33:37.874664 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:33:37.874664 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:33:36 up 47 min,  2 users,  load average: 1.61, 3.66, 4.41\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_8598c291629242869fa2a040db124338': '1', 'io_workload': '0'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:33:37.956175 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:33:37.956420 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:33:38.458711 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:33:38.965236 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:33:38.965236 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.140s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:38.965907 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:39.965519 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:39.966105 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:39.966411 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:39.966709 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:40.106436 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:40.183616 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:40.183765 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:40.183939 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:40.184061 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:40.184160 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:40.186132 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Terminating instance
May 13 04:33:40.688563 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:33:40.703345 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.705911 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.721547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.728949 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.743743 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.749186 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.831866 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:40.832235 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:40.832435 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:40.832543 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:40.832745 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] No waiting events found dispatching network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:33:40.832786 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-0f9fdd18-17b1-43d3-83b1-d3b9f65b3f41 req-4ca54df2-0591-47f1-a240-5acf00d31139 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:33:40.969969 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:40.975971 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.000175 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999696154000048 future=<Future at 0x7a464826b770 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:41.000484 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999356152000018 future=<Future at 0x7a464826b770 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:41.000584 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.9992551979999 future=<Future at 0x7a464826b770 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:41.001580 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Instance destroyed successfully.
May 13 04:33:41.001922 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lazy-loading 'resources' on Instance uuid b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:33:41.083884 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:41.084351 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:41.465738 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.504083 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032014400',display_name='tempest-SnapshotDataIntegrityTests-server-1032014400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-snapshotdataintegritytests-server-1032014400',id=77,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFJtq0IS5LiFN7xL9YXiKi75qR+pmxBGAju0mrqdMML9EOe5Cx/ZlpR8euD3oU8yTDWJ+cWmLIlt61TmHASPzPllXWpWkf0qzykmjSva4F9XlEmxuwZh/TzUBh08Xlubg==',key_name='tempest-keypair-1665837235',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:31:34Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8598c291629242869fa2a040db124338',ramdisk_id='',reservation_id='r-vy2m4oq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1376363296',owner_user_name='tempest-SnapshotDataIntegrityTests-1376363296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8bb448acc641ed89797bcaf8e7a639',uuid=b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:33:41.504374 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converting VIF {"id": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "address": "fa:16:3e:90:f2:26", "network": {"id": "db2f9f96-ae78-4460-aca4-772d0a2f6d05", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-820962141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8598c291629242869fa2a040db124338", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap671a5aa8-08", "ovs_interfaceid": "671a5aa8-080d-4872-a0b6-47ef96c2f46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:33:41.504996 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:33:41.505242 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:33:41.506395 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.506566 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap671a5aa8-08, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:33:41.507376 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.508100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:33:41.508468 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.509058 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.509185 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b764238-f1cd-4433-8ce1-d66f06236796) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:33:41.509547 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.509993 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:33:41.510167 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:41.511715 np0000000669 nova-compute[97951]: INFO os_vif [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f2:26,bridge_name='br-int',has_traffic_filtering=True,id=671a5aa8-080d-4872-a0b6-47ef96c2f46b,network=Network(db2f9f96-ae78-4460-aca4-772d0a2f6d05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671a5aa8-08')
May 13 04:33:41.512015 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Deleting instance files /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3_del
May 13 04:33:41.512884 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Deletion of /opt/stack/data/nova/instances/b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3_del complete
May 13 04:33:42.019844 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Took 1.33 seconds to destroy the instance on the hypervisor.
May 13 04:33:42.020451 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:33:42.020725 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:33:42.020841 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:33:42.021093 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:33:42.109066 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:33:42.482794 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9def286d-68ec-475a-9ebf-17b181d7608f req-1c175a82-e3e9-43ce-b7a4-967b8dce48c1 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-deleted-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:42.483140 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-9def286d-68ec-475a-9ebf-17b181d7608f req-1c175a82-e3e9-43ce-b7a4-967b8dce48c1 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Neutron deleted interface 671a5aa8-080d-4872-a0b6-47ef96c2f46b; detaching it from the instance and deleting it from the info cache
May 13 04:33:42.483293 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-9def286d-68ec-475a-9ebf-17b181d7608f req-1c175a82-e3e9-43ce-b7a4-967b8dce48c1 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:33:42.884601 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:33:42.884947 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] Acquiring lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:42.885094 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:42.885227 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:42.885354 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] No waiting events found dispatching network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:33:42.885470 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d8b5815a-43c2-49ca-b5c8-313c939a478c req-44863d40-68e3-4321-9694-a3b44f554425 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Received event network-vif-unplugged-671a5aa8-080d-4872-a0b6-47ef96c2f46b for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:33:42.933926 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:33:42.986813 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9def286d-68ec-475a-9ebf-17b181d7608f req-1c175a82-e3e9-43ce-b7a4-967b8dce48c1 service nova] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Detach interface failed, port_id=671a5aa8-080d-4872-a0b6-47ef96c2f46b, reason: Instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:33:43.083771 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:43.083771 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:33:43.084398 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:43.435773 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Took 1.41 seconds to deallocate network for instance.
May 13 04:33:43.940612 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:33:43.940867 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:33:44.026839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:33:44.027037 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:33:44.529290 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:33:45.035008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.094s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:45.078486 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Deleted allocations for instance b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3
May 13 04:33:46.087294 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bc30fedc-5bd3-4511-b959-c4fb388bcd3b tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Lock "b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.903s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:33:46.510968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:47.079507 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:33:47.079935 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:33:48.718423 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:50.205915 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:51.511610 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:53.616590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:55.572152 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:55.592038 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:56.000181 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003192839999428543 future=<Future at 0x7a464826b770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:56.001749 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] Emitting event <LifecycleEvent: 1778646820.9997783, b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:33:56.001939 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:33:56.002069 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] VM Stopped (Lifecycle Event)
May 13 04:33:56.504300 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-5e6373e5-794c-4c59-a8f7-0d87d1c4a589 tempest-SnapshotDataIntegrityTests-1376363296 tempest-SnapshotDataIntegrityTests-1376363296-project-member] [instance: b63dbbdd-1bcf-437c-aaaa-6d5f7859e5a3] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:33:56.513375 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:57.700170 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:33:58.958382 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:00.592590 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:01.515083 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:02.219460 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:02.219880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:02.721232 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:34:03.265918 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:03.266250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:03.269610 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:34:03.269734 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Claim successful on node np0000000669
May 13 04:34:04.354857 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:34:04.355307 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:34:04.858809 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:34:05.365397 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.098s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:05.365397 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:34:05.593264 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:05.870443 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:34:05.870654 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:34:05.870925 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:05.871159 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:05.936225 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '183422f277bf46d7a02252f7d9e42744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fede022df634a7aaad4c86c82fe41ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:34:06.317200 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Successfully created port: ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:34:06.373346 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:34:06.515777 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:06.773642 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Successfully updated port: ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:34:06.823974 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:34:06.824133 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing instance network info cache due to event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:34:06.824542 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] Acquiring lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:34:06.824674 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] Acquired lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:34:06.824838 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing network info cache for port ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:34:06.876644 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:34:07.275564 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:34:07.326768 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:07.387984 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:34:07.412437 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:07.509300 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:34:07.884119 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:34:07.884774 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:34:07.884988 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Creating image(s)
May 13 04:34:07.885408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:07.885561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:07.886412 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:07.886870 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:34:07.889171 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:34:07.890101 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:07.983223 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:07.983826 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:07.984512 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:07.985147 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:34:07.989285 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:34:07.989754 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:08.012949 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-127695b6-13e2-48d3-a29f-82923f61b4d5 req-4a494165-24d0-474e-9925-017cae6c8b5a service nova] Releasing lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:34:08.014288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquired lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:34:08.014604 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:34:08.101880 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.112s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:08.102679 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:08.165639 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk 1073741824" returned: 0 in 0.063s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:08.166309 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:08.166834 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:08.254214 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:08.254803 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:34:08.255198 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:08.349068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:08.349559 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Cannot resize image /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:34:08.350087 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:34:08.350318 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Ensure instance console log exists: /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:34:08.350678 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:08.350962 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:08.351161 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:08.579112 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:34:08.713684 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:08.821553 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:34:09.323875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Releasing lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:34:09.324203 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance network_info: |[{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:34:09.325959 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Start _get_guest_xml network_info=[{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:34:09.330207 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:34:09.331407 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-145352332', uuid='e1101020-952b-4fa2-8182-f16dba618383'), owner=OwnerMeta(userid='183422f277bf46d7a02252f7d9e42744', username='tempest-VolumeMultiattachTests-1986363338-project-member', projectid='0fede022df634a7aaad4c86c82fe41ad', projectname='tempest-VolumeMultiattachTests-1986363338'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646849.3310387) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:34:09.332654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:34:09.332934 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:34:09.333903 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:34:09.334065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:34:09.334891 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:34:09.335193 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:34:09.335435 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:34:09.335435 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:34:09.335539 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:34:09.335613 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:34:09.335697 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:34:09.335859 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:34:09.335975 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:34:09.336079 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:34:09.336180 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:34:09.336300 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:34:09.345955 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-145352332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-145352332',id=79,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-uhyzhesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=e1101020-952b-4fa2-8182-f16dba618383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:34:09.346393 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:34:09.346910 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:34:09.347419 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'pci_devices' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:34:09.850235 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] End _get_guest_xml xml=<domain type="qemu">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <uuid>e1101020-952b-4fa2-8182-f16dba618383</uuid>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <name>instance-0000004f</name>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumeMultiattachTests-server-145352332</nova:name>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:34:09</nova:creationTime>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:user uuid="183422f277bf46d7a02252f7d9e42744">tempest-VolumeMultiattachTests-1986363338-project-member</nova:user>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:project uuid="0fede022df634a7aaad4c86c82fe41ad">tempest-VolumeMultiattachTests-1986363338</nova:project>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         <nova:port uuid="ac43ba3c-b359-43b2-a9e0-f68cad055da8">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <system>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="serial">e1101020-952b-4fa2-8182-f16dba618383</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="uuid">e1101020-952b-4fa2-8182-f16dba618383</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </system>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <os>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </os>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <features>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </features>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   <devices>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </disk>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.config"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </disk>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:cd:9c:66"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <target dev="tapac43ba3c-b3"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </interface>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/console.log" append="off"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </serial>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <video>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </video>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </rng>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:   </devices>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]: </domain>
May 13 04:34:09.850235 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Preparing to wait for external event network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-145352332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-145352332',id=79,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-uhyzhesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=e1101020-952b-4fa2-8182-f16dba618383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:34:09.853112 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.853649 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:34:09.853717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:34:09.854216 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.854405 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec0f8953-4b78-5bbd-9d34-409026652eeb', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:34:09.855278 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.856041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:34:09.856249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.858524 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.858723 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac43ba3c-b3, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:34:09.859070 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac43ba3c-b3, col_values=(('qos', UUID('75c546b0-0d80-43d6-8837-026e40be3998')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:34:09.859261 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac43ba3c-b3, col_values=(('external_ids', {'iface-id': 'ac43ba3c-b359-43b2-a9e0-f68cad055da8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:9c:66', 'vm-uuid': 'e1101020-952b-4fa2-8182-f16dba618383'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:34:09.859998 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.861104 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:34:09.865337 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:09.866128 np0000000669 nova-compute[97951]: INFO os_vif [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3')
May 13 04:34:10.605213 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:11.382494 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:34:11.382936 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:34:11.382936 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:cd:9c:66, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:34:11.383191 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Using config drive
May 13 04:34:11.889489 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:11.998964 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Creating config drive at /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.config
May 13 04:34:12.003030 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnex6az1m {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:12.060712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnex6az1m" returned: 0 in 0.057s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:12.431816 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.451790 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.539796 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.542516 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.583235 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-15be017e-c31b-4cca-8f66-8c71c382d826 req-1f4acae6-66a3-42ce-ba39-f004583d5837 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:34:12.583764 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-15be017e-c31b-4cca-8f66-8c71c382d826 req-1f4acae6-66a3-42ce-ba39-f004583d5837 service nova] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:12.584010 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-15be017e-c31b-4cca-8f66-8c71c382d826 req-1f4acae6-66a3-42ce-ba39-f004583d5837 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:12.584250 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-15be017e-c31b-4cca-8f66-8c71c382d826 req-1f4acae6-66a3-42ce-ba39-f004583d5837 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:12.584398 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-15be017e-c31b-4cca-8f66-8c71c382d826 req-1f4acae6-66a3-42ce-ba39-f004583d5837 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Processing event network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:34:12.711592 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.713061 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.716291 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:12.744834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:13.125855 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646853.1254008, e1101020-952b-4fa2-8182-f16dba618383 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:34:13.126354 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:34:13.126548 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] VM Started (Lifecycle Event)
May 13 04:34:13.128773 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:34:13.130961 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance spawned successfully.
May 13 04:34:13.131136 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:34:13.629076 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:34:13.631245 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:34:13.638180 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:13.638444 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:13.638876 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:13.639149 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:13.639467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:13.639769 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:34:14.133411 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:34:14.133639 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646854.1334913, e1101020-952b-4fa2-8182-f16dba618383 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:34:14.133745 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] VM Paused (Lifecycle Event)
May 13 04:34:14.145436 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Took 6.26 seconds to spawn the instance on the hypervisor.
May 13 04:34:14.145619 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:34:14.636188 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:34:14.638444 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646854.6381886, e1101020-952b-4fa2-8182-f16dba618383 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:34:14.638598 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] VM Resumed (Lifecycle Event)
May 13 04:34:14.647622 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:34:14.647820 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:14.647986 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:14.648124 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:14.648256 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] No waiting events found dispatching network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:34:14.648425 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-761f10b9-09d5-4bed-b822-fbdbcbc811eb req-3181e2e7-cae2-4de6-8e87-c5467e35e7fa service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received unexpected event network-vif-plugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 for instance with vm_state active and task_state None.
May 13 04:34:14.654008 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Took 11.43 seconds to build instance.
May 13 04:34:14.860844 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:15.141241 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:34:15.143695 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: e1101020-952b-4fa2-8182-f16dba618383] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:34:15.155237 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:15.615660 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:16.709671 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:34:16.710124 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing instance network info cache due to event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:34:16.710351 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] Acquiring lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:34:16.710457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] Acquired lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:34:16.710622 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing network info cache for port ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:34:17.212747 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:17.495595 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:34:17.607225 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updated VIF entry in instance network info cache for port ac43ba3c-b359-43b2-a9e0-f68cad055da8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:34:17.607492 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:34:18.109246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7624c3fd-8c3b-4626-8806-6b0dae7eadd4 req-00a4e7dc-324b-44bd-94e9-910ade738a94 service nova] Releasing lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:34:19.861669 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:20.630398 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:24.862897 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:25.649245 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:29.863458 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:30.657442 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:32.084177 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:32.084177 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 04:34:32.587602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] There are 0 instances to clean {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 04:34:32.588005 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:33.582668 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:33.583191 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:34.083930 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:34.084077 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 04:34:34.585877 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:34.864912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:35.585641 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:35.585886 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:35.669000 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:36.083870 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:36.590096 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:36.590353 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:36.590480 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:36.590605 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:34:37.608854 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:37.695369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:37.695369 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:37.777707 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:37.781903 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:34:37.783266 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:37.827332 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:34:37.827857 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=14032MB free_disk=72.64070510864258GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:34:37.828169 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:37.828511 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:38.881338 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e1101020-952b-4fa2-8182-f16dba618383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:34:38.881338 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:34:38.881338 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:34:37 up 48 min,  2 users,  load average: 2.34, 3.48, 4.29\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_0fede022df634a7aaad4c86c82fe41ad': '1', 'io_workload': '0'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:34:38.963704 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:34:38.963704 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:34:39.465079 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:34:39.865707 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:39.970931 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:34:39.971391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.143s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:39.971516 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:40.680894 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:40.971625 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:40.972068 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:40.972068 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:40.972145 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.11 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:43.083696 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:43.084177 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:44.866542 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:45.083706 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:45.083846 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:34:45.084064 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:34:45.585834 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:34:45.682249 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:49.867704 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:54.869041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:55.515095 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:55.515426 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:55.703767 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:34:56.018276 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:34:57.023339 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:34:58.074930 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:34:58.075336 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:34:58.075409 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attaching volume 01995672-b7ee-41b8-85cc-2338b94272f6 to /dev/vdb
May 13 04:34:58.108770 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:34:58.119257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:34:58.142158 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:34:58.183052 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:34:58.183370 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:34:58.192023 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:34:58.192945 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fecd:9c66', 'fe80::68e8:f7ff:fea1:337f'] 
May 13 04:34:58.193045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:34:58.193158 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:34:58.193414 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:34:58.193660 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating existing volume attachment record: f8714e96-f875-49e1-9ee6-a58b4047f5be {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:34:58.736458 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:34:58.736806 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:34:58.736967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:34:58.737384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:34:58.737598 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:34:58.748070 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:34:58.749401 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:34:58.749880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:34:58.750306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:34:58.750550 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:34:58.750749 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:34:58.761859 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:34:58.761859 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:58.762579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:34:58.762579 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:58.771891 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6] added
May 13 04:34:58.771891 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:34:58.771891 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:34:58.771891 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:34:58.771891 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:34:58.771891 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:34:58.771891 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:58.772120 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:34:58.772344 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:34:58.772552 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:34:58.774010 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6] added
May 13 04:34:58.774010 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:34:58.774010 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:34:58.774010 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:34:58.774010 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:34:58.774010 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:34:58.774010 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:58.774260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:34:58.774382 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:34:58.774545 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:34:59.773135 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:34:59.774940 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:34:59.785380 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:34:59.785380 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:34:59.791229 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:34:59.791229 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:59.796634 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:59.803511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:34:59.807723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:34:59.807723 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:34:59.807833 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:34:59.807833 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:34:59.807936 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:34:59.807936 np0000000669 nova-compute[97951]: 
May 13 04:34:59.813038 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:34:59.813038 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:34:59.813180 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:34:59.813180 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:34:59.813299 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:34:59.813299 np0000000669 nova-compute[97951]: 
May 13 04:34:59.870320 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:00.836380 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.40.100,3260]
May 13 04:35:00.836380 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.40.100,3260] successful.
May 13 04:35:00.836380 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:00.843567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.50.100,3260]
May 13 04:35:00.843567 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.50.100,3260] successful.
May 13 04:35:00.843567 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:00.847694 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:00.854454 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:00.859892 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.859892 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.859892 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:00.860059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.860059 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.860059 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:00.860298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.110s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:00.860443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:00.860872 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('7', '-', '-', 0) found on session 221 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:00.860974 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:00.867921 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.867921 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.867921 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:00.868077 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.868077 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:00.868077 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:00.868368 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:00.868496 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:00.869022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('8', '-', '-', 0) found on session 222 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:00.869159 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:00.874542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:00.874542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:00.882898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 222 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:00.882898 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:01.750712 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:35:02.765586 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found WWN 3300000001fe6127d for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:35:02.765967 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:02.766030 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '3300000001fe6127d', 'path': '/dev/dm-0', 'multipath_id': '3300000001fe6127d'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:35:02.766148 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001fe6127d', 'path': '/dev/dm-0', 'multipath_id': '3300000001fe6127d'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:35:02.769524 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:03.272933 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to attach volume 01995672-b7ee-41b8-85cc-2338b94272f6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:35:03.274539 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:   <alias name="ua-01995672-b7ee-41b8-85cc-2338b94272f6"/>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:   <serial>01995672-b7ee-41b8-85cc-2338b94272f6</serial>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]: </disk>
May 13 04:35:03.274539 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:35:04.871609 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:04.912827 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:04.912958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:04.913049 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:04.913100 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:cd:9c:66, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:35:06.349241 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:06.454107 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bf2091da-4618-4470-9d99-aa1220e0b2d0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.379s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:06.454641 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.105s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:06.958546 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:07.963706 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:09.029545 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:09.029965 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:09.029965 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attaching volume 5e447f0c-2b48-43f3-8487-6be752b854be to /dev/vdc
May 13 04:35:09.062271 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:35:09.072160 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:35:09.092238 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:09.133676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:35:09.134013 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:35:09.141678 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:35:09.142626 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fecd:9c66', 'fe80::68e8:f7ff:fea1:337f'] 
May 13 04:35:09.142770 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:35:09.142914 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:35:09.143196 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:35:09.143518 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating existing volume attachment record: fae56587-0a1b-4602-b3ee-9f4b49b12ef7 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:35:09.714051 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e1101020-952b-4fa2-8182-f16dba618383', 'attached_at': '', 'detached_at': '', 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'serial': '5e447f0c-2b48-43f3-8487-6be752b854be'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:35:09.717519 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:35:09.717910 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:35:09.718067 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:09.718548 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:09.718769 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:35:09.730800 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:09.731575 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:09.732116 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:09.732698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:09.732966 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:35:09.733227 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:35:09.745095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:35:09.745095 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:09.746758 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:35:09.746758 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:09.756564 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be] added
May 13 04:35:09.756564 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:35:09.756564 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:09.756564 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:09.756564 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:09.756564 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:09.756564 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:09.756785 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:35:09.756934 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:35:09.757063 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:35:09.759293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be] added
May 13 04:35:09.759293 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:35:09.759293 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:09.759293 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:09.759293 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:09.759293 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:09.759293 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:09.759517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:35:09.759771 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:35:09.759955 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:35:09.873358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:10.757527 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:35:10.760656 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:35:10.769497 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:35:10.769497 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:35:10.773605 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:35:10.773605 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.780606 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.784969 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.792542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.792542 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.792542 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:10.792702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.792702 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.792702 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:10.798766 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.798766 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.798766 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:10.798930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.798930 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.798930 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:10.820467 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.50.100,3260]
May 13 04:35:10.820467 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.50.100,3260] successful.
May 13 04:35:10.820467 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.831207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.839511 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.40.100,3260]
May 13 04:35:10.839511 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.40.100,3260] successful.
May 13 04:35:10.839511 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.846461 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.846461 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.846461 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.846461 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.846461 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:10.846660 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.846660 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.846660 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.846660 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.846660 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:10.846844 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:10.846917 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:10.847552 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('9', '-', '-', 0) found on session 223 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:10.847733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:10.852301 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:10.861384 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:10.867073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.867073 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.867073 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.867073 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.867073 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:10.867226 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.867226 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:10.867226 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.867226 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:10.867226 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:10.867519 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:10.867657 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:10.868290 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('10', '-', '-', 0) found on session 224 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:10.868453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:10.880884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 224 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:10.880884 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:11.861558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:11.862035 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:12.747165 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found WWN 3300000009f3e41a7 for multipath device dm-1 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:35:12.747457 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:12.748239 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000009f3e41a7', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000009f3e41a7'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:35:12.748432 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f3e41a7', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000009f3e41a7'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:35:12.750640 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:35:12.750900 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:35:12.751064 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:35:12.765718 np0000000669 nova-compute[97951]: WARNING os_brick.encryptors.luks [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 04:35:12.766002 np0000000669 nova-compute[97951]: WARNING stevedore.named [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 04:35:12.766158 np0000000669 nova-compute[97951]: WARNING castellan.key_manager [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:35:12.766304 np0000000669 nova-compute[97951]: WARNING nova.keymgr.conf_key_mgr [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 04:35:12.766851 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7a46480971a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'e1101020-952b-4fa2-8182-f16dba618383', 'attached_at': '', 'detached_at': '', 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'serial': '5e447f0c-2b48-43f3-8487-6be752b854be'} {{(pid=97951) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 04:35:12.766992 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors.luks [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] formatting encrypted volume /dev/dm-1 {{(pid=97951) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 04:35:14.874699 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:16.535405 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 04:35:16.535405 np0000000669 nova-compute[97951]:   <usage type="volume">
May 13 04:35:16.535405 np0000000669 nova-compute[97951]:     <volume>5e447f0c-2b48-43f3-8487-6be752b854be</volume>
May 13 04:35:16.535405 np0000000669 nova-compute[97951]:   </usage>
May 13 04:35:16.535405 np0000000669 nova-compute[97951]: </secret>
May 13 04:35:16.535405 np0000000669 nova-compute[97951]:  {{(pid=97951) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 04:35:16.542390 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:17.044700 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to attach volume 5e447f0c-2b48-43f3-8487-6be752b854be with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:35:17.046134 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <alias name="ua-5e447f0c-2b48-43f3-8487-6be752b854be"/>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <serial>5e447f0c-2b48-43f3-8487-6be752b854be</serial>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="1342324b-8ed9-491c-9fa5-2bb92f5fdf0d"/>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]: </disk>
May 13 04:35:17.046134 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:35:19.613667 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:19.614128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:19.614128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:19.614128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:19.614128 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:cd:9c:66, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:35:19.875948 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:21.159556 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-9a9aba64-025e-4640-8bf2-2792ca4b6959 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.130s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:21.866246 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:21.866623 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:22.369899 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:23.375189 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:24.434913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:24.435188 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:24.435445 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attaching volume 85881c98-bb13-48bb-8898-99e72237de69 to /dev/vdd
May 13 04:35:24.467214 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:35:24.477418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:35:24.495885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:24.536138 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:35:24.536446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:35:24.545413 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:35:24.546274 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fecd:9c66', 'fe80::68e8:f7ff:fea1:337f'] 
May 13 04:35:24.546425 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:35:24.546562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:35:24.546805 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:35:24.547061 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating existing volume attachment record: ba1db0f4-dd70-4a08-b474-aa43c7fc2d93 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:35:24.876598 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:25.092209 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:35:25.092562 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:35:25.092796 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:25.093252 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:25.093498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:35:25.105059 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:25.105613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:25.105801 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:35:25.106545 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:35:25.107106 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:35:25.107293 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:35:25.117505 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:35:25.117505 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:25.122539 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:35:25.122539 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:25.130088 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69] added
May 13 04:35:25.130088 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:35:25.130088 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:25.130088 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:25.130088 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:25.130088 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:25.130088 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:25.130257 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:35:25.130433 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:35:25.130563 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:35:25.134842 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69] added
May 13 04:35:25.134842 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:35:25.134842 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:25.134842 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:25.134842 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:35:25.134842 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:35:25.134842 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:25.135025 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:35:25.135147 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:35:25.135237 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:35:25.707142 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:26.131017 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:35:26.135655 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:35:26.142607 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:35:26.142607 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:35:26.147717 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:35:26.147717 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.154827 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.159702 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.168484 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.168484 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.168484 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.168484 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.168484 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:26.168725 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.168725 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.168725 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.168725 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.168725 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:26.174005 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.174005 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.174005 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.174005 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.174005 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:26.174194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.174194 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.174194 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.174194 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.174194 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:26.200345 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.40.100,3260]
May 13 04:35:26.200345 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.40.100,3260] successful.
May 13 04:35:26.200345 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.208514 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.50.100,3260]
May 13 04:35:26.208514 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.50.100,3260] successful.
May 13 04:35:26.208514 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.212330 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.220517 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.226807 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.227083 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:26.227293 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:26.227455 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:26.228154 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('11', '-', '-', 0) found on session 225 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:26.228260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.234337 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:35:26.234498 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:35:26.234625 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:26.234764 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:35:26.235497 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('12', '-', '-', 0) found on session 226 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:35:26.235613 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:35:26.241795 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 225 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:26.241942 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:26.249955 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 226 and hctl ['12', '*', '*', 0] yield: None {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:27.248977 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 226 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:35:27.249365 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:35:28.121867 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found WWN 3300000005130233e for multipath device dm-2 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:35:28.122152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:35:28.122252 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000005130233e', 'path': '/dev/dm-2', 'multipath_id': '3300000005130233e'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:35:28.122347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005130233e', 'path': '/dev/dm-2', 'multipath_id': '3300000005130233e'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:35:28.124893 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:28.628065 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to attach volume 85881c98-bb13-48bb-8898-99e72237de69 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:35:28.629413 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <target dev="vdd" bus="virtio"/>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]: </disk>
May 13 04:35:28.629413 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:35:29.877550 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:30.264113 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:30.264214 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:30.264366 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:30.264434 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdd, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:30.264499 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:30.264561 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:cd:9c:66, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:35:31.815807 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-38d49b2a-f986-4cda-85af-dae85a0600d8 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.381s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:34.157175 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:34.157768 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:34.580758 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:34.581187 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:34.659407 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:35:34.878517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:35.282252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:35.282664 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:35.285458 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:35:35.285599 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Claim successful on node np0000000669
May 13 04:35:35.709348 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:36.329882 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Refreshing inventories for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 04:35:36.368691 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Updating ProviderTree inventory for provider 7fc6428b-bc57-40b4-8243-357124d5276c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 04:35:36.368884 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Updating inventory in ProviderTree for provider 7fc6428b-bc57-40b4-8243-357124d5276c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 04:35:36.405651 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Refreshing aggregate associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, aggregates: None {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 04:35:36.446941 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Refreshing trait associations for resource provider 7fc6428b-bc57-40b4-8243-357124d5276c, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_ICH9,HW_ARCH_X86_64,HW_CPU_X86_SSE,COMPUTE_ARCH_X86_64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ARCH_PPC64LE,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI {{(pid=97951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 04:35:36.562875 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:35:36.563135 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:35:37.065905 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:35:37.083874 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:37.084194 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:37.573464 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.291s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:37.573960 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:35:38.079873 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:35:38.080369 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:35:38.081334 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:38.081713 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:38.083642 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:38.139994 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '183422f277bf46d7a02252f7d9e42744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fede022df634a7aaad4c86c82fe41ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:35:38.429561 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:38.565556 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Successfully created port: 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:35:38.583837 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:35:38.588079 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:38.588233 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:38.588400 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:38.588566 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:35:38.936244 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Successfully updated port: 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:35:38.979502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-changed-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:35:38.979502 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Refreshing instance network info cache due to event network-changed-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:35:38.979689 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] Acquiring lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:35:38.979792 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] Acquired lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:35:38.980163 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Refreshing network info cache for port 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:35:39.086814 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:35:39.438133 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:35:39.481652 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:39.533356 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:35:39.610787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:39.664536 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:35:39.695561 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:39.695913 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:39.780705 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:39.781398 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:35:39.781536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:35:39.781586 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:35:39.785985 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:35:39.787003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:39.831559 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:39.831906 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=14031MB free_disk=72.63698959350586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:35:39.832049 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:39.832278 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:39.879619 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:40.096234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:35:40.097336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:35:40.097560 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Creating image(s)
May 13 04:35:40.098210 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:40.098408 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:40.098838 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:40.099439 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:35:40.101926 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:35:40.103062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:40.115285 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:40.167199 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-d431ef2b-a5b1-4e3d-ba02-eae7b64407c4 req-f5e4fea3-f620-4dfc-9c19-2c0044dc7cf6 service nova] Releasing lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:35:40.168379 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquired lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:35:40.168379 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:35:40.192068 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:40.192459 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:40.192861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:40.193258 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:35:40.195719 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:35:40.196005 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:40.277927 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.082s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:40.278446 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:40.331138 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk 1073741824" returned: 0 in 0.052s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:40.331565 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:40.331861 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:40.417252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.085s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:40.417661 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:35:40.417899 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:40.505279 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:40.505717 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Cannot resize image /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:35:40.506266 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:35:40.506478 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Ensure instance console log exists: /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:35:40.506763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:40.506982 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:40.507149 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:40.726907 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:35:40.855622 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:40.902865 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e1101020-952b-4fa2-8182-f16dba618383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:35:40.903008 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:35:40.903178 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:35:40.903341 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:35:39 up 49 min,  2 users,  load average: 1.04, 2.89, 4.04\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_0fede022df634a7aaad4c86c82fe41ad': '2', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:35:40.983807 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating instance_info_cache with network_info: [{"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:35:41.028902 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:35:41.029565 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:35:41.488735 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Releasing lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:35:41.489003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance network_info: |[{"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:35:41.491530 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Start _get_guest_xml network_info=[{"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:35:41.494316 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:35:41.496171 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1579697300', uuid='bb6e3d9a-11e6-4002-8a11-6e6c45937109'), owner=OwnerMeta(userid='183422f277bf46d7a02252f7d9e42744', username='tempest-VolumeMultiattachTests-1986363338-project-member', projectid='0fede022df634a7aaad4c86c82fe41ad', projectname='tempest-VolumeMultiattachTests-1986363338'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778646941.4956748) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:35:41.497589 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:35:41.497950 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:35:41.499006 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:35:41.499219 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:35:41.500632 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:35:41.501097 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:35:41.501269 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:35:41.501626 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:35:41.501626 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:35:41.501626 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:35:41.501735 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:35:41.501839 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:35:41.501935 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:35:41.502039 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:35:41.502133 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:35:41.502242 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:35:41.511992 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1579697300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-1579697300',id=80,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-bbrio7uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=bb6e3d9a-11e6-4002-8a11-6e6c45937109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:35:41.512171 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:35:41.512698 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:35:41.513450 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'pci_devices' on Instance uuid bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:35:41.532583 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:35:42.015986 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] End _get_guest_xml xml=<domain type="qemu">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <uuid>bb6e3d9a-11e6-4002-8a11-6e6c45937109</uuid>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <name>instance-00000050</name>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumeMultiattachTests-server-1579697300</nova:name>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:35:41</nova:creationTime>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:user uuid="183422f277bf46d7a02252f7d9e42744">tempest-VolumeMultiattachTests-1986363338-project-member</nova:user>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:project uuid="0fede022df634a7aaad4c86c82fe41ad">tempest-VolumeMultiattachTests-1986363338</nova:project>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         <nova:port uuid="13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <system>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="serial">bb6e3d9a-11e6-4002-8a11-6e6c45937109</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="uuid">bb6e3d9a-11e6-4002-8a11-6e6c45937109</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </system>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <os>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </os>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <features>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </features>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   <devices>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </disk>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.config"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </disk>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:87:95:89"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <target dev="tap13f83b1b-40"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </interface>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/console.log" append="off"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </serial>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <video>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </video>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </rng>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:   </devices>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]: </domain>
May 13 04:35:42.015986 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Preparing to wait for external event network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1579697300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-1579697300',id=80,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-bbrio7uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=bb6e3d9a-11e6-4002-8a11-6e6c45937109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:35:42.018234 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:35:42.018632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.018978 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:35:42.019302 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:35:42.019997 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.020131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be536af4-7d14-5210-9c73-54f6b47176da', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:35:42.021567 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.021652 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:35:42.022045 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.023762 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.023910 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13f83b1b-40, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:35:42.024228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13f83b1b-40, col_values=(('qos', UUID('faad56da-fd41-4202-98b5-3396a2cf9ca4')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:35:42.024621 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13f83b1b-40, col_values=(('external_ids', {'iface-id': '13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:95:89', 'vm-uuid': 'bb6e3d9a-11e6-4002-8a11-6e6c45937109'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:35:42.026722 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:35:42.031569 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:42.032700 np0000000669 nova-compute[97951]: INFO os_vif [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40')
May 13 04:35:42.038484 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:35:42.038650 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.206s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:42.038958 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:43.038938 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:43.039287 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:43.039431 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:43.039701 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.04 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:43.547553 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:43.547688 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:35:43.547781 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:87:95:89, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:35:43.548202 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Using config drive
May 13 04:35:44.053099 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:44.083585 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:44.084391 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:44.156974 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Creating config drive at /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.config
May 13 04:35:44.160667 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8nnjhtdw {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:35:44.211795 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8nnjhtdw" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:35:44.586659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.601491 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.602870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.686003 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.700572 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.701492 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:44.726822 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4a6508f6-4b4e-46bc-8a69-696b50787a04 req-6d9243e6-7830-40d0-b764-4fc37f49d0a0 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:35:44.727251 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4a6508f6-4b4e-46bc-8a69-696b50787a04 req-6d9243e6-7830-40d0-b764-4fc37f49d0a0 service nova] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:44.727475 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4a6508f6-4b4e-46bc-8a69-696b50787a04 req-6d9243e6-7830-40d0-b764-4fc37f49d0a0 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:44.727736 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-4a6508f6-4b4e-46bc-8a69-696b50787a04 req-6d9243e6-7830-40d0-b764-4fc37f49d0a0 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:44.727736 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-4a6508f6-4b4e-46bc-8a69-696b50787a04 req-6d9243e6-7830-40d0-b764-4fc37f49d0a0 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Processing event network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:35:45.229154 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646945.2287097, bb6e3d9a-11e6-4002-8a11-6e6c45937109 => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:35:45.229928 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:35:45.230522 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] VM Started (Lifecycle Event)
May 13 04:35:45.232725 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:35:45.235247 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance spawned successfully.
May 13 04:35:45.235962 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:35:45.718275 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:45.734275 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:35:45.736131 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:35:45.742536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:45.742674 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:45.742965 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:45.743184 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:45.743434 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:45.743674 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:35:46.240193 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:35:46.240528 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646946.2402787, bb6e3d9a-11e6-4002-8a11-6e6c45937109 => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:35:46.240528 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] VM Paused (Lifecycle Event)
May 13 04:35:46.247736 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Took 6.15 seconds to spawn the instance on the hypervisor.
May 13 04:35:46.247930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:35:46.742864 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:35:46.745304 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778646946.745079, bb6e3d9a-11e6-4002-8a11-6e6c45937109 => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:35:46.745453 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] VM Resumed (Lifecycle Event)
May 13 04:35:46.758194 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Took 11.59 seconds to build instance.
May 13 04:35:46.781571 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:35:46.781762 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:35:46.781943 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:35:46.782277 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:46.782569 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] No waiting events found dispatching network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:35:46.782629 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-7dc7d47a-6f89-4349-a49a-ff915ccaaab2 req-d4f194a1-f929-4167-81a3-c3546bd00cb1 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received unexpected event network-vif-plugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 for instance with vm_state active and task_state None.
May 13 04:35:47.025100 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:47.083856 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:47.084033 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:35:47.084263 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:47.247784 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:35:47.250028 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:35:47.259862 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-fce2a548-667c-4b4f-9ade-d737c48a61a0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.102s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:35:48.066330 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:35:48.066847 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing instance network info cache due to event network-changed-ac43ba3c-b359-43b2-a9e0-f68cad055da8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:35:48.067002 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] Acquiring lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:35:48.067095 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] Acquired lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:35:48.067214 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Refreshing network info cache for port ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:35:48.570987 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:48.813039 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:48.924686 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updated VIF entry in instance network info cache for port ac43ba3c-b359-43b2-a9e0-f68cad055da8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:35:48.924993 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [{"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:35:49.426846 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-64785bfc-9090-498c-b49f-43695d099eac req-77cec586-2d1c-447c-a4c2-a8c18b8a505c service nova] Releasing lock "refresh_cache-e1101020-952b-4fa2-8182-f16dba618383" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:35:50.079187 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:35:50.079556 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:35:50.130168 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-changed-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:35:50.130566 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Refreshing instance network info cache due to event network-changed-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:35:50.130712 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] Acquiring lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:35:50.130799 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] Acquired lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:35:50.130899 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Refreshing network info cache for port 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:35:50.632999 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:50.726025 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:50.898189 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:35:51.007310 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updated VIF entry in instance network info cache for port 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:35:51.007590 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating instance_info_cache with network_info: [{"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:35:51.509267 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-87adef0b-4d53-451e-8383-52c6c62d9347 req-8a859fc3-2136-4059-a3e4-dde814a365e5 service nova] Releasing lock "refresh_cache-bb6e3d9a-11e6-4002-8a11-6e6c45937109" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:35:52.026860 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:55.744385 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:35:57.027664 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:00.743121 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:02.029078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:05.759078 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:07.030232 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:10.762286 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:12.030695 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:15.773118 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:17.031940 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:22.032256 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:24.636508 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:24.636885 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:25.139744 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:25.794537 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:26.144173 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:27.033580 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:27.209875 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:27.210053 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:27.210247 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Attaching volume 85881c98-bb13-48bb-8898-99e72237de69 to /dev/vdb
May 13 04:36:27.253599 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:36:27.265105 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:36:27.287365 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:36:27.330211 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:36:27.330493 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:36:27.338353 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:36:27.339244 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fecd:9c66', 'fe80::68e8:f7ff:fea1:337f', 'fe80::fc16:3eff:fe87:9589'] 
May 13 04:36:27.339405 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:36:27.339466 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:36:27.339727 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:36:27.339947 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating existing volume attachment record: b422f504-2cda-41d6-9c9c-4f3df6a713cc {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:36:27.887363 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:36:27.887640 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:36:27.887811 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:27.888274 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:27.888504 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:36:27.900075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:27.900786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:27.901305 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:27.901542 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:36:27.901973 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:27.902209 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:36:27.912888 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:36:27.912888 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.startup = automatic
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.scan = manual
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:36:27.919138 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:36:27.919138 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:27.925955 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:27.932302 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.941847 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.942066 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:36:27.942330 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.041s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:27.942477 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:36:27.943221 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('11', '0', '0', 0) found on session 225 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:36:27.943372 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.948993 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:27.949187 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:36:27.949418 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:27.949518 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:36:27.949996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('12', '0', '0', 0) found on session 226 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:36:27.950101 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:36:27.956560 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 225 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:36:27.956771 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:36:27.959108 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 226 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:36:27.959314 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:36:28.903258 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:36:29.917737 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found WWN 3300000005130233e for multipath device dm-2 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:36:29.918099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:29.918099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== connect_volume: return (2030ms) {'type': 'block', 'scsi_wwn': '3300000005130233e', 'path': '/dev/dm-2', 'multipath_id': '3300000005130233e'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:36:29.918205 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005130233e', 'path': '/dev/dm-2', 'multipath_id': '3300000005130233e'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:36:29.920846 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:30.424070 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Attempting to attach volume 85881c98-bb13-48bb-8898-99e72237de69 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:36:30.425672 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:30.425672 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:36:32.034821 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:32.051949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:36:32.051949 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:36:32.052117 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:36:32.052117 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:87:95:89, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:36:33.591961 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-7edffa60-fcde-4866-8885-d6cd469d3fe9 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.382s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:34.081375 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:34.081375 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:35.304282 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:35.305728 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:35.808114 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Detaching volume 85881c98-bb13-48bb-8898-99e72237de69
May 13 04:36:35.816657 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:35.849956 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Attempting to driver detach volume 85881c98-bb13-48bb-8898-99e72237de69 from mountpoint /dev/vdb
May 13 04:36:35.855787 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-85881c98-bb13-48bb-8898-99e72237de69 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:35.857162 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-85881c98-bb13-48bb-8898-99e72237de69 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:35.857353 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Attempting to detach device vdb from instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:36:35.857651 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:35.857651 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:35.863799 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 from the persistent domain config.
May 13 04:36:35.864082 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] (1/8): Attempting to detach device vdb with device alias ua-85881c98-bb13-48bb-8898-99e72237de69 from instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:36:35.864347 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:35.864347 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:36.314552 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778646996.3141363, bb6e3d9a-11e6-4002-8a11-6e6c45937109 => ua-85881c98-bb13-48bb-8898-99e72237de69> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:36:36.315953 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-85881c98-bb13-48bb-8898-99e72237de69 for instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:36:36.318672 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 from the live domain config.
May 13 04:36:36.858444 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Detected multiple connections on this host for volume: 85881c98-bb13-48bb-8898-99e72237de69, skipping target disconnect.
May 13 04:36:37.035374 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:37.403787 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:38.083849 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:38.084214 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:38.408987 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-cda80572-b7b5-4fd4-9e88-f101992068ee tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.104s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:38.498457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:38.498457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:38.498457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:38.498457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:38.498457 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:38.500276 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Terminating instance
May 13 04:36:39.003471 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:36:39.016187 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.018221 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.029433 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.083718 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:39.084023 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:39.130618 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.135755 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.151758 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:36:39.152252 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:39.152472 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:39.152647 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:39.152754 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] No waiting events found dispatching network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:36:39.153006 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-053ad3d7-cd0d-4ced-8521-ff6c7276dc4e req-5cbe2a57-ffe4-47dc-b9a9-0990b8a46057 service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:36:39.319070 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999646223000127 future=<Future at 0x7a461c787470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:39.319356 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999332492000121 future=<Future at 0x7a461c787470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:39.319488 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999178812000082 future=<Future at 0x7a461c787470 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:39.320847 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Instance destroyed successfully.
May 13 04:36:39.321260 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'resources' on Instance uuid bb6e3d9a-11e6-4002-8a11-6e6c45937109 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:39.588831 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:39.589254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:39.589254 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:39.589352 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:36:39.823440 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1579697300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-1579697300',id=80,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:35:46Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-bbrio7uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=bb6e3d9a-11e6-4002-8a11-6e6c45937109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:36:39.823688 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "address": "fa:16:3e:87:95:89", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f83b1b-40", "ovs_interfaceid": "13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:36:39.824161 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:36:39.824393 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:36:39.825539 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.825717 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13f83b1b-40, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:36:39.826653 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.827332 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:36:39.827600 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.828174 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.828290 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faad56da-fd41-4202-98b5-3396a2cf9ca4) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:36:39.828685 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:39.829172 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:36:39.830751 np0000000669 nova-compute[97951]: INFO os_vif [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:95:89,bridge_name='br-int',has_traffic_filtering=True,id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f83b1b-40')
May 13 04:36:39.831003 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Deleting instance files /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109_del
May 13 04:36:39.831672 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Deletion of /opt/stack/data/nova/instances/bb6e3d9a-11e6-4002-8a11-6e6c45937109_del complete
May 13 04:36:40.337058 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Took 1.33 seconds to destroy the instance on the hypervisor.
May 13 04:36:40.337636 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:36:40.337952 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:36:40.338067 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:36:40.338298 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:36:40.421930 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:36:40.609025 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:36:40.702210 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:36:40.702739 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:36:40.731076 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:40.792055 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:36:40.792410 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:36:40.792522 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:36:40.792624 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=97951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 04:36:40.796389 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Error from libvirt while getting description of instance-00000050: [Error Code 42] Domain not found: no domain with matching uuid 'bb6e3d9a-11e6-4002-8a11-6e6c45937109' (instance-00000050): libvirt.libvirtError: Domain not found: no domain with matching uuid 'bb6e3d9a-11e6-4002-8a11-6e6c45937109' (instance-00000050)
May 13 04:36:40.798300 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:36:40.799216 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:36:40.825045 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86c78bf4-4228-4077-a21f-e80b4c4ad536 req-20460fc6-120b-49e1-b638-06e968d3635d service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-deleted-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:36:40.825246 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-86c78bf4-4228-4077-a21f-e80b4c4ad536 req-20460fc6-120b-49e1-b638-06e968d3635d service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Neutron deleted interface 13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8; detaching it from the instance and deleting it from the info cache
May 13 04:36:40.825449 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-86c78bf4-4228-4077-a21f-e80b4c4ad536 req-20460fc6-120b-49e1-b638-06e968d3635d service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:36:40.844713 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:36:40.844948 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=14020MB free_disk=72.59725189208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:36:40.845076 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:40.845299 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:41.210144 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:36:41.210654 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] Acquiring lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:41.210844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:41.210984 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:41.211162 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] No waiting events found dispatching network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:36:41.211289 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-fef7fe35-70e9-4c89-8d6b-2dcaa13fe90d req-28742412-4125-40ef-89ec-2bf5d909286c service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Received event network-vif-unplugged-13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:36:41.258986 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:36:41.330070 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-86c78bf4-4228-4077-a21f-e80b4c4ad536 req-20460fc6-120b-49e1-b638-06e968d3635d service nova] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Detach interface failed, port_id=13f83b1b-40a7-4190-ad90-5d2f0dcd6bd8, reason: Instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:36:41.761057 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Took 1.42 seconds to deallocate network for instance.
May 13 04:36:41.896715 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance e1101020-952b-4fa2-8182-f16dba618383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:36:41.896852 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance bb6e3d9a-11e6-4002-8a11-6e6c45937109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:36:41.897050 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:36:41.897191 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:36:40 up 50 min,  2 users,  load average: 0.68, 2.47, 3.82\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_0fede022df634a7aaad4c86c82fe41ad': '2', 'io_workload': '0', 'num_task_deleting': '1'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:36:42.016063 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:36:42.016266 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:36:42.268420 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:42.518992 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:36:43.026282 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:36:43.026829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.181s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:43.026829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.758s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:43.027156 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:43.191758 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:36:43.191970 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:36:43.694549 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:36:44.201851 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:44.244936 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Deleted allocations for instance bb6e3d9a-11e6-4002-8a11-6e6c45937109
May 13 04:36:44.830280 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:45.026718 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:45.026935 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:45.027185 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.06 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:45.083736 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:45.084350 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:45.252387 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e6791903-e7df-48b8-bdbb-b20b8659dd99 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "bb6e3d9a-11e6-4002-8a11-6e6c45937109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.754s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:45.567538 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:45.567680 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:46.070223 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Detaching volume 85881c98-bb13-48bb-8898-99e72237de69
May 13 04:36:46.108418 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to driver detach volume 85881c98-bb13-48bb-8898-99e72237de69 from mountpoint /dev/vdd
May 13 04:36:46.113096 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdd by alias ua-85881c98-bb13-48bb-8898-99e72237de69 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:46.114385 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdd by alias ua-85881c98-bb13-48bb-8898-99e72237de69 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:46.114510 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Attempting to detach device vdd from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:36:46.114745 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <target dev="vdd" bus="virtio"/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:46.114745 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:46.122006 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdd from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config.
May 13 04:36:46.122168 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] (1/8): Attempting to detach device vdd with device alias ua-85881c98-bb13-48bb-8898-99e72237de69 from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:36:46.122417 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <alias name="ua-85881c98-bb13-48bb-8898-99e72237de69"/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-2"/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <target dev="vdd" bus="virtio"/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <serial>85881c98-bb13-48bb-8898-99e72237de69</serial>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:46.122417 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:46.571424 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778647006.5709786, e1101020-952b-4fa2-8182-f16dba618383 => ua-85881c98-bb13-48bb-8898-99e72237de69> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:36:46.572458 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-85881c98-bb13-48bb-8898-99e72237de69 for instance e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:36:46.574663 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdd from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config.
May 13 04:36:46.600054 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:36:46.600394 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:36:46.600731 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:46.601051 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:46.601333 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '85881c98-bb13-48bb-8898-99e72237de69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:36:46.601476 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:46.623661 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69 (non-flash)
May 13 04:36:46.623985 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '224'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', '226')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:36:46.623985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', '225')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:46.624880 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69', '226')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:46.625563 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a463c74b880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'): ({'sdg'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:36:46.625745 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Removing multipathed devices sdf, sdg {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:36:46.625955 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flush multipath device 3300000005130233e {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:36:46.658617 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:46.695583 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:46.746612 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:36:46.746821 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:36:46.747720 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:36:46.757245 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:36:46.757476 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:36:46.767116 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.798512 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.40.100,3260]
May 13 04:36:46.798512 np0000000669 nova-compute[97951]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.40.100,3260] successful.
May 13 04:36:46.798512 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.813045 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.824677 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.860453 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.50.100,3260]
May 13 04:36:46.860453 np0000000669 nova-compute[97951]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-85881c98-bb13-48bb-8898-99e72237de69, portal: 192.168.50.100,3260] successful.
May 13 04:36:46.860453 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.874151 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:46.874367 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:46.874482 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== disconnect_volume: return (273ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:36:46.874601 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:36:47.413882 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:48.419458 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-193617f0-d1ac-40f4-a1ff-1c7045410911 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.851s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:48.975760 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:48.975934 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:49.083666 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:36:49.083815 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:36:49.084015 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:36:49.477938 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Detaching volume 5e447f0c-2b48-43f3-8487-6be752b854be
May 13 04:36:49.535048 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to driver detach volume 5e447f0c-2b48-43f3-8487-6be752b854be from mountpoint /dev/vdc
May 13 04:36:49.558493 np0000000669 nova-compute[97951]: DEBUG os_brick.encryptors [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'e1101020-952b-4fa2-8182-f16dba618383', 'attached_at': '', 'detached_at': '', 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'serial': '5e447f0c-2b48-43f3-8487-6be752b854be'} {{(pid=97951) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 04:36:49.562201 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdc by alias ua-5e447f0c-2b48-43f3-8487-6be752b854be {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:49.563336 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdc by alias ua-5e447f0c-2b48-43f3-8487-6be752b854be {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:49.563447 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Attempting to detach device vdc from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:36:49.563654 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <alias name="ua-5e447f0c-2b48-43f3-8487-6be752b854be"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <serial>5e447f0c-2b48-43f3-8487-6be752b854be</serial>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="1342324b-8ed9-491c-9fa5-2bb92f5fdf0d"/>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:49.563654 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:49.568098 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdc from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config.
May 13 04:36:49.568239 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] (1/8): Attempting to detach device vdc with device alias ua-5e447f0c-2b48-43f3-8487-6be752b854be from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:36:49.568467 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <alias name="ua-5e447f0c-2b48-43f3-8487-6be752b854be"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <target dev="vdc" bus="virtio"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <serial>5e447f0c-2b48-43f3-8487-6be752b854be</serial>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   <encryption format="luks">
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:     <secret type="passphrase" uuid="1342324b-8ed9-491c-9fa5-2bb92f5fdf0d"/>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:   </encryption>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:49.568467 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:49.831214 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:49.988931 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778647009.9881353, e1101020-952b-4fa2-8182-f16dba618383 => ua-5e447f0c-2b48-43f3-8487-6be752b854be> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:36:49.989582 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-5e447f0c-2b48-43f3-8487-6be752b854be for instance e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:36:49.994336 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdc from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config.
May 13 04:36:49.996896 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:36:49.997148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:36:49.997277 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:49.997658 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:49.997906 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e447f0c-2b48-43f3-8487-6be752b854be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:36:49.998021 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:36:50.021167 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:50.021167 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:50.021167 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:50.021167 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:50.021167 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:36:50.021414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:50.021414 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:50.021414 np0000000669 nova-compute[97951]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:50.021414 np0000000669 nova-compute[97951]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be (non-flash)
May 13 04:36:50.021414 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:36:50.021414 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '224')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:36:50.021569 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '224')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:50.022438 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be', '223')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:50.023072 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a46480b68e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'): ({'sdd'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:36:50.023251 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Removing multipathed devices sdd, sde {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:36:50.023464 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flush multipath device 3300000009f3e41a7 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:36:50.060615 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:50.119148 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:50.157715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:36:50.157876 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:36:50.158629 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:36:50.171596 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:36:50.171760 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:36:50.181604 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.215091 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.40.100,3260]
May 13 04:36:50.215091 np0000000669 nova-compute[97951]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.40.100,3260] successful.
May 13 04:36:50.215091 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.227567 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.237286 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.266175 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.50.100,3260]
May 13 04:36:50.266175 np0000000669 nova-compute[97951]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-5e447f0c-2b48-43f3-8487-6be752b854be, portal: 192.168.50.100,3260] successful.
May 13 04:36:50.266175 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.278249 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:50.279179 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:50.279378 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== disconnect_volume: return (281ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:36:50.279536 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:36:50.823173 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:51.828382 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-bea3c623-15ca-4903-ba56-dbf91b6a3c3b tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.852s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:52.238855 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:52.239011 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:52.742391 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Detaching volume 01995672-b7ee-41b8-85cc-2338b94272f6
May 13 04:36:52.782807 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Attempting to driver detach volume 01995672-b7ee-41b8-85cc-2338b94272f6 from mountpoint /dev/vdb
May 13 04:36:52.787795 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-01995672-b7ee-41b8-85cc-2338b94272f6 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:52.788959 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-01995672-b7ee-41b8-85cc-2338b94272f6 {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:36:52.789067 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Attempting to detach device vdb from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:36:52.789254 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <alias name="ua-01995672-b7ee-41b8-85cc-2338b94272f6"/>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <serial>01995672-b7ee-41b8-85cc-2338b94272f6</serial>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:52.789254 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:52.794545 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance e1101020-952b-4fa2-8182-f16dba618383 from the persistent domain config.
May 13 04:36:52.794671 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] (1/8): Attempting to detach device vdb with device alias ua-01995672-b7ee-41b8-85cc-2338b94272f6 from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:36:52.794855 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <alias name="ua-01995672-b7ee-41b8-85cc-2338b94272f6"/>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <serial>01995672-b7ee-41b8-85cc-2338b94272f6</serial>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]: </disk>
May 13 04:36:52.794855 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:36:53.232403 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778647013.2320354, e1101020-952b-4fa2-8182-f16dba618383 => ua-01995672-b7ee-41b8-85cc-2338b94272f6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:36:53.233318 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-01995672-b7ee-41b8-85cc-2338b94272f6 for instance e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:36:53.235574 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance e1101020-952b-4fa2-8182-f16dba618383 from the live domain config.
May 13 04:36:53.236504 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:36:53.236793 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:36:53.236936 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:36:53.237306 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:36:53.237608 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01995672-b7ee-41b8-85cc-2338b94272f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:36:53.237697 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:36:53.259391 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:53.259391 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:53.259391 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:36:53.259551 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:53.259551 np0000000669 nova-compute[97951]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6 (non-flash)
May 13 04:36:53.259551 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:36:53.259719 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '222')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:36:53.259887 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '221')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:53.260506 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6', '222')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:36:53.261095 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648214220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:36:53.261260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:36:53.261499 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flush multipath device 3300000001fe6127d {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:36:53.292808 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:53.338889 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:36:53.387810 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:36:53.388015 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:36:53.388690 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:36:53.400854 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:36:53.401074 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:36:53.411542 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.438721 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.40.100,3260]
May 13 04:36:53.438721 np0000000669 nova-compute[97951]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.40.100,3260] successful.
May 13 04:36:53.438721 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.451459 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.464349 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.489549 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.50.100,3260]
May 13 04:36:53.489549 np0000000669 nova-compute[97951]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-01995672-b7ee-41b8-85cc-2338b94272f6, portal: 192.168.50.100,3260] successful.
May 13 04:36:53.489549 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.499931 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:36:53.500207 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:36:53.500389 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== disconnect_volume: return (263ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:36:53.500570 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:36:54.047643 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:54.319099 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0003833979999399162 future=<Future at 0x7a461c787470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:54.319668 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Emitting event <LifecycleEvent: 1778646999.3186045, bb6e3d9a-11e6-4002-8a11-6e6c45937109 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:36:54.319824 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:54.319970 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] VM Stopped (Lifecycle Event)
May 13 04:36:54.822279 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: bb6e3d9a-11e6-4002-8a11-6e6c45937109] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:36:54.833195 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:55.052956 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e9d58efb-4360-4aa7-ad5f-b66f8a8e0055 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.814s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:58.759829 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:58.760247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:58.760247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:58.760247 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:58.760395 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:58.762044 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Terminating instance
May 13 04:36:59.264815 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:36:59.278653 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:59.280189 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:59.298971 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:59.315868 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:36:59.432714 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:36:59.433165 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:36:59.433292 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:36:59.433912 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:36:59.434048 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] No waiting events found dispatching network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:36:59.434168 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-1d415fe2-2953-4450-a1c0-f321c3b39c94 req-5a2083c7-4895-423f-94d4-834ffaf549a2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:36:59.585130 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999722266999925 future=<Future at 0x7a46481eb350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:59.585428 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999232134000067 future=<Future at 0x7a46481eb350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:59.585658 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.99897283600012 future=<Future at 0x7a46481eb350 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:36:59.586198 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] Instance destroyed successfully.
May 13 04:36:59.586543 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'resources' on Instance uuid e1101020-952b-4fa2-8182-f16dba618383 {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:36:59.834414 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.088778 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-145352332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-145352332',id=79,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZBp4jOE9oe7wGAy4x8NSaNLLre8ghIKRgJ+mK7yvxgl9eT8Xcg3k09uXA3ZAZFQjEe2wl7wiH3vvMGFZc+MR056oShO2wGwHeig5TjgneK0HfpHdTc1cMQ8MII3YOnmA==',key_name='tempest-keypair-296907684',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:34:14Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-uhyzhesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:34:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=e1101020-952b-4fa2-8182-f16dba618383,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:37:00.088984 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "address": "fa:16:3e:cd:9c:66", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac43ba3c-b3", "ovs_interfaceid": "ac43ba3c-b359-43b2-a9e0-f68cad055da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:37:00.089418 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:37:00.089637 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:37:00.090833 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.091123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac43ba3c-b3, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:00.092227 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.092925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:37:00.093517 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.093632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75c546b0-0d80-43d6-8837-026e40be3998) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:00.093980 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.094372 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:37:00.094489 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:00.095957 np0000000669 nova-compute[97951]: INFO os_vif [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=ac43ba3c-b359-43b2-a9e0-f68cad055da8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac43ba3c-b3')
May 13 04:37:00.096189 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Deleting instance files /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383_del
May 13 04:37:00.096912 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Deletion of /opt/stack/data/nova/instances/e1101020-952b-4fa2-8182-f16dba618383_del complete
May 13 04:37:00.602231 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Took 1.34 seconds to destroy the instance on the hypervisor.
May 13 04:37:00.603424 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:37:00.603744 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:37:00.603832 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:37:00.604081 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:00.690738 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:00.949185 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3c08824a-5964-4313-a934-aa1ffb3af336 req-32948c1c-e6a4-4616-8dfc-290d6f8f92f1 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-deleted-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:00.949571 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-3c08824a-5964-4313-a934-aa1ffb3af336 req-32948c1c-e6a4-4616-8dfc-290d6f8f92f1 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Neutron deleted interface ac43ba3c-b359-43b2-a9e0-f68cad055da8; detaching it from the instance and deleting it from the info cache
May 13 04:37:00.949735 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-3c08824a-5964-4313-a934-aa1ffb3af336 req-32948c1c-e6a4-4616-8dfc-290d6f8f92f1 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:37:01.378288 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:37:01.453165 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-3c08824a-5964-4313-a934-aa1ffb3af336 req-32948c1c-e6a4-4616-8dfc-290d6f8f92f1 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Detach interface failed, port_id=ac43ba3c-b359-43b2-a9e0-f68cad055da8, reason: Instance e1101020-952b-4fa2-8182-f16dba618383 could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:37:01.483169 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:01.483316 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] Acquiring lock "e1101020-952b-4fa2-8182-f16dba618383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:01.483810 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:01.484046 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] Lock "e1101020-952b-4fa2-8182-f16dba618383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:01.484216 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] No waiting events found dispatching network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:37:01.484419 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-37080d8e-7ee6-4d3c-86b8-113d0379b678 req-5021b7d6-8ea5-4f2b-aa3e-30a37af211e2 service nova] [instance: e1101020-952b-4fa2-8182-f16dba618383] Received event network-vif-unplugged-ac43ba3c-b359-43b2-a9e0-f68cad055da8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:37:01.880215 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: e1101020-952b-4fa2-8182-f16dba618383] Took 1.28 seconds to deallocate network for instance.
May 13 04:37:02.385069 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:02.385602 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:02.468290 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:37:02.468501 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:37:02.970648 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:37:03.476205 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.091s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:03.517795 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Deleted allocations for instance e1101020-952b-4fa2-8182-f16dba618383
May 13 04:37:04.525062 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-2ed69c65-5abc-496a-95fe-d2062d4b11e5 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "e1101020-952b-4fa2-8182-f16dba618383" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.765s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:05.095221 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:07.338627 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:07.339008 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:07.840734 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Starting instance... {{(pid=97951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 04:37:08.383729 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:08.384060 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:08.387087 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 04:37:08.387222 np0000000669 nova-compute[97951]: INFO nova.compute.claims [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Claim successful on node np0000000669
May 13 04:37:09.470885 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:37:09.471237 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:37:09.973280 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:37:10.097254 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:10.479608 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.095s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:10.480115 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Start building networks asynchronously for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 04:37:10.986070 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Allocating IP information in the background. {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 04:37:10.986216 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] allocate_for_instance() {{(pid=97951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 04:37:10.986455 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:10.986639 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:11.043848 np0000000669 nova-compute[97951]: DEBUG nova.policy [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '183422f277bf46d7a02252f7d9e42744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fede022df634a7aaad4c86c82fe41ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97951) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 04:37:11.468915 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Successfully created port: 938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 04:37:11.489052 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 04:37:11.844030 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Successfully updated port: 938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 04:37:11.886183 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-changed-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:11.886256 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Refreshing instance network info cache due to event network-changed-938742ee-7b4d-4922-8ce2-55ba7080f6b8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:37:11.886368 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] Acquiring lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:37:11.886463 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] Acquired lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:37:11.886566 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Refreshing network info cache for port 938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:37:11.991683 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Start building block device mappings for instance. {{(pid=97951) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 04:37:12.346147 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:37:12.389173 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:12.440232 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:37:12.556227 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:37:13.000234 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Start spawning the instance on the hypervisor. {{(pid=97951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 04:37:13.001156 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Creating instance directory {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 04:37:13.001421 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Creating image(s)
May 13 04:37:13.001849 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:13.001985 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:13.002414 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:13.002942 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:37:13.005423 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:37:13.006518 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:13.059231 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-6f31720a-cc6b-4dfc-9379-86a5a230a594 req-2e6c9818-e3b8-4bc7-888e-6495b2dafca1 service nova] Releasing lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:37:13.060135 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquired lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:37:13.060445 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Building network info cache for instance {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 04:37:13.091070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:13.091474 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "d808da2396547a8cb3c315c9b668b821f56bc62d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:13.091896 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:13.092277 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:37:13.094621 np0000000669 nova-compute[97951]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 04:37:13.094934 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:13.177886 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.083s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:13.178386 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk 1073741824 {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:13.226502 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d,backing_fmt=raw /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk 1073741824" returned: 0 in 0.048s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:13.226977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "d808da2396547a8cb3c315c9b668b821f56bc62d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.135s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:13.227271 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:13.313761 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d808da2396547a8cb3c315c9b668b821f56bc62d --force-share --output=json" returned: 0 in 0.086s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:13.314183 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk. size=1073741824 {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 04:37:13.314437 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:13.402645 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:13.403021 np0000000669 nova-compute[97951]: DEBUG nova.virt.disk.api [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Cannot resize image /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk to a smaller size. {{(pid=97951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 04:37:13.403408 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Created local disks {{(pid=97951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 04:37:13.403569 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Ensure instance console log exists: /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/console.log {{(pid=97951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 04:37:13.403870 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:13.404029 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:13.404145 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:13.619132 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance cache missing network info. {{(pid=97951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 04:37:13.754403 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:13.863419 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating instance_info_cache with network_info: [{"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:37:14.365787 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Releasing lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:37:14.366173 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance network_info: |[{"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 04:37:14.368839 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Start _get_guest_xml network_info=[{"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'image_id': '21f6dd9f-a6e8-4103-9a88-7de2ff01268f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 04:37:14.375222 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:37:14.377012 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-964454895', uuid='3ce5422b-a042-45cc-853b-42bf60b29f6f'), owner=OwnerMeta(userid='183422f277bf46d7a02252f7d9e42744', username='tempest-VolumeMultiattachTests-1986363338-project-member', projectid='0fede022df634a7aaad4c86c82fe41ad', projectname='tempest-VolumeMultiattachTests-1986363338'), image=ImageMeta(id='21f6dd9f-a6e8-4103-9a88-7de2ff01268f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778647034.3765519) {{(pid=97951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 04:37:14.378439 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V1... {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 04:37:14.378842 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller missing on host. {{(pid=97951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 04:37:14.380001 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching host: 'np0000000669' for CPU controller through CGroups V2... {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 04:37:14.380203 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.host [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU controller found on host. {{(pid=97951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 04:37:14.381392 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 04:37:14.381837 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T04:09:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T04:09:38Z,direct_url=<?>,disk_format='qcow2',id=21f6dd9f-a6e8-4103-9a88-7de2ff01268f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='fb27ee19f7a1411896edf4c068d8ad2b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T04:09:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 04:37:14.382041 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 04:37:14.382195 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image limits 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 04:37:14.382413 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flavor pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 04:37:14.382556 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Image pref 0:0:0 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 04:37:14.382703 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 04:37:14.382959 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 04:37:14.383124 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 04:37:14.383306 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got 1 possible topologies {{(pid=97951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 04:37:14.383502 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 04:37:14.383681 np0000000669 nova-compute[97951]: DEBUG nova.virt.hardware [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 04:37:14.401267 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-964454895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-964454895',id=81,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxVcDPPzD3cG/yFNUDfyokHcOeUVgAaf+PBULgSKYm9w7uzznImCJj2YL1FtQMRrWYoEHT2NzPtReZQUBiSGNX4Ilte9HylByIFZ1jEDyIfPGf3nM3cyuir6QZ5Lpvyhw==',key_name='tempest-keypair-31678955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-o1iac9ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=3ce5422b-a042-45cc-853b-42bf60b29f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 04:37:14.401558 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:37:14.402242 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:37:14.402973 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:37:14.585107 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.0004374320001261367 future=<Future at 0x7a46481eb350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:37:14.585540 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Emitting event <LifecycleEvent: 1778647019.584562, e1101020-952b-4fa2-8182-f16dba618383 => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:37:14.585668 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:37:14.585800 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] VM Stopped (Lifecycle Event)
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] End _get_guest_xml xml=<domain type="qemu">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <uuid>3ce5422b-a042-45cc-853b-42bf60b29f6f</uuid>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <name>instance-00000051</name>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <memory>196608</memory>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <vcpu>1</vcpu>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <metadata>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:package version="33.1.0"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:name>tempest-VolumeMultiattachTests-server-964454895</nova:name>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:creationTime>2026-05-13 04:37:14</nova:creationTime>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:flavor name="m1.nano" id="42">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:memory>192</nova:memory>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:disk>1</nova:disk>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:swap>0</nova:swap>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:ephemeral>0</nova:ephemeral>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:vcpus>1</nova:vcpus>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:extraSpecs>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         </nova:extraSpecs>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       </nova:flavor>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:image uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:minDisk>1</nova:minDisk>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:minRam>0</nova:minRam>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:properties>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         </nova:properties>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       </nova:image>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:owner>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:user uuid="183422f277bf46d7a02252f7d9e42744">tempest-VolumeMultiattachTests-1986363338-project-member</nova:user>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:project uuid="0fede022df634a7aaad4c86c82fe41ad">tempest-VolumeMultiattachTests-1986363338</nova:project>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       </nova:owner>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:root type="image" uuid="21f6dd9f-a6e8-4103-9a88-7de2ff01268f"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <nova:ports>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         <nova:port uuid="938742ee-7b4d-4922-8ce2-55ba7080f6b8">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:         </nova:port>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       </nova:ports>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </nova:instance>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </metadata>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <sysinfo type="smbios">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <system>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="product">OpenStack Nova</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="version">33.1.0</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="serial">3ce5422b-a042-45cc-853b-42bf60b29f6f</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="uuid">3ce5422b-a042-45cc-853b-42bf60b29f6f</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <entry name="family">Virtual Machine</entry>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </system>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </sysinfo>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <os>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <boot dev="hd"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <smbios mode="sysinfo"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </os>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <features>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <acpi/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <tcg>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <tb-cache unit="MiB">128</tb-cache>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </tcg>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <vmcoreinfo/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </features>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <iothreads>1</iothreads>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <clock offset="utc"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <cpu mode="custom" match="exact">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <model>Nehalem</model>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <topology sockets="1" cores="1" threads="1"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </cpu>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   <devices>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <disk type="file" device="disk">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <target dev="vda" bus="virtio"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </disk>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <disk type="file" device="cdrom">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <driver name="qemu" type="raw" cache="none"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <source file="/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.config"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <target dev="hda" bus="ide"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </disk>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <interface type="ethernet">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <mac address="fa:16:3e:7a:11:ff"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <driver name="qemu"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <mtu size="1372"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <target dev="tap938742ee-7b"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </interface>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <serial type="pty">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <log file="/opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/console.log" append="off"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </serial>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <video>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <model type="virtio"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </video>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <rng model="virtio">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <backend model="random">/dev/urandom</backend>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </rng>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <controller type="usb" index="0" model="none"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:       <stats period="10"/>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:     </memballoon>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:   </devices>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: </domain>
May 13 04:37:14.906438 np0000000669 nova-compute[97951]:  {{(pid=97951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Preparing to wait for external event network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:14.906438 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T04:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-964454895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-964454895',id=81,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxVcDPPzD3cG/yFNUDfyokHcOeUVgAaf+PBULgSKYm9w7uzznImCJj2YL1FtQMRrWYoEHT2NzPtReZQUBiSGNX4Ilte9HylByIFZ1jEDyIfPGf3nM3cyuir6QZ5Lpvyhw==',key_name='tempest-keypair-31678955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-o1iac9ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T04:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=3ce5422b-a042-45cc-853b-42bf60b29f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b') {{(pid=97951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:14.908870 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 04:37:14.909384 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.909516 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2d76e90-49ed-5acd-8fdc-d33af7f2d1f8', '_type': 'linux-noop'}}, row=False) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:14.917207 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.918059 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:37:14.918295 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.920123 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.920228 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap938742ee-7b, may_exist=True, interface_attrs={}) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:14.920509 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap938742ee-7b, col_values=(('qos', UUID('d087f4b3-2963-4941-b922-6bbdeb48fe2c')),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:14.920659 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap938742ee-7b, col_values=(('external_ids', {'iface-id': '938742ee-7b4d-4922-8ce2-55ba7080f6b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:11:ff', 'vm-uuid': '3ce5422b-a042-45cc-853b-42bf60b29f6f'}),), if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:37:14.921274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.922387 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:37:14.926341 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:14.927257 np0000000669 nova-compute[97951]: INFO os_vif [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b')
May 13 04:37:15.088154 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: e1101020-952b-4fa2-8182-f16dba618383] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:37:16.440629 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:37:16.441004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:37:16.441004 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:7a:11:ff, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:37:16.441161 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Using config drive
May 13 04:37:16.946007 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:17.060558 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Creating config drive at /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.config
May 13 04:37:17.064300 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkx_3j0ih {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:17.116187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkx_3j0ih" returned: 0 in 0.051s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:17.497471 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.509903 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.513242 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.599881 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.602139 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.628849 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-93da5f92-b4a6-4692-84cc-763b5112508d req-63dbbd67-a670-45ed-830e-f0a263fe398d service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:17.629070 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-93da5f92-b4a6-4692-84cc-763b5112508d req-63dbbd67-a670-45ed-830e-f0a263fe398d service nova] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:17.629280 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-93da5f92-b4a6-4692-84cc-763b5112508d req-63dbbd67-a670-45ed-830e-f0a263fe398d service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:17.629421 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-93da5f92-b4a6-4692-84cc-763b5112508d req-63dbbd67-a670-45ed-830e-f0a263fe398d service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:17.630072 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-93da5f92-b4a6-4692-84cc-763b5112508d req-63dbbd67-a670-45ed-830e-f0a263fe398d service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Processing event network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 04:37:17.785675 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.787005 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.789149 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:17.799968 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:18.159340 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778647038.1589704, 3ce5422b-a042-45cc-853b-42bf60b29f6f => Started> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:37:18.159715 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 04:37:18.159875 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] VM Started (Lifecycle Event)
May 13 04:37:18.162595 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Guest created on hypervisor {{(pid=97951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 04:37:18.165042 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance spawned successfully.
May 13 04:37:18.166219 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 04:37:18.662542 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:37:18.664602 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:37:18.671616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_cdrom_bus of ide {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:18.671616 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_disk_bus of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:18.671869 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_input_bus of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:18.671958 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_pointer_model of None {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:18.672174 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_video_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:18.673551 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Found default for hw_vif_model of virtio {{(pid=97951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 04:37:19.166634 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 04:37:19.166856 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778647039.1667073, 3ce5422b-a042-45cc-853b-42bf60b29f6f => Paused> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:37:19.166949 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] VM Paused (Lifecycle Event)
May 13 04:37:19.176690 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Took 6.18 seconds to spawn the instance on the hypervisor.
May 13 04:37:19.176831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:37:19.668977 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:37:19.671202 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Emitting event <LifecycleEvent: 1778647039.6710374, 3ce5422b-a042-45cc-853b-42bf60b29f6f => Resumed> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:37:19.671316 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] VM Resumed (Lifecycle Event)
May 13 04:37:19.690259 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Took 11.35 seconds to build instance.
May 13 04:37:19.701283 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:19.701466 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:19.701638 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:19.701734 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:19.701863 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] No waiting events found dispatching network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:37:19.702001 np0000000669 nova-compute[97951]: WARNING nova.compute.manager [req-9edfb69c-f429-497e-97bc-81f4b6970012 req-89af800a-d4a5-42a8-ad67-cad7006be57a service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received unexpected event network-vif-plugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 for instance with vm_state active and task_state None.
May 13 04:37:19.921493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:20.174031 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:37:20.176149 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 04:37:20.194596 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-c1c4e2aa-a03d-4b4c-be28-39f98af8b4f2 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.856s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:20.822284 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:21.760003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-changed-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:37:21.760003 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Refreshing instance network info cache due to event network-changed-938742ee-7b4d-4922-8ce2-55ba7080f6b8. {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 04:37:21.760003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] Acquiring lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 04:37:21.760003 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] Acquired lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 04:37:21.760003 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Refreshing network info cache for port 938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 04:37:22.264348 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:22.524500 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:37:22.635726 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updated VIF entry in instance network info cache for port 938742ee-7b4d-4922-8ce2-55ba7080f6b8. {{(pid=97951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 04:37:22.636037 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating instance_info_cache with network_info: [{"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:37:23.137726 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-2a7201c6-e38c-41eb-9d80-dd0c89dd300d req-1bb86fda-5380-4d7d-8fc1-4d3edfcb93cf service nova] Releasing lock "refresh_cache-3ce5422b-a042-45cc-853b-42bf60b29f6f" {{(pid=97951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 04:37:24.922506 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:25.840927 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:29.923394 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:30.855890 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:34.925369 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:35.868358 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:36.079028 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:36.079499 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:39.083625 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:39.084053 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:39.588928 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:39.589126 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:39.589298 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:39.589468 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:37:39.926485 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:40.108335 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:40.607539 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:40.692215 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:40.692683 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:40.783490 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:40.787421 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:37:40.788513 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:40.832024 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:37:40.832450 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=14030MB free_disk=72.62302017211914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:37:40.832637 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:40.832840 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:40.877299 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:41.882908 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Instance 3ce5422b-a042-45cc-853b-42bf60b29f6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 04:37:41.883373 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:37:41.883373 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:37:40 up 51 min,  2 users,  load average: 0.73, 2.14, 3.62\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_0fede022df634a7aaad4c86c82fe41ad': '1', 'io_workload': '0'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:37:41.963863 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:37:41.964077 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:37:42.466468 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:37:42.972186 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:37:42.972769 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.140s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:42.972769 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:43.972792 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:43.973172 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:43.973256 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.11 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:44.927921 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:45.083625 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:45.083991 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:45.084019 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:45.878402 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:47.125240 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:47.125629 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:47.628534 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:37:48.632676 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:49.704977 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:49.705394 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:49.705394 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Attaching volume 0d8fac2e-cf42-40d3-90e7-f13a97911b2b to /dev/vdb
May 13 04:37:49.736045 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.26', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000669', 'execute': None}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:37:49.746073 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.scaleio [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 04:37:49.763636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Running cmd (subprocess): nvme version {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:37:49.806872 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] 'nvme version' failed. Not Retrying. {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 04:37:49.807129 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] nvme not present on system {{(pid=97951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 04:37:49.815253 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 04:37:49.816073 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.lightos [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Current host hostNQN  and IP(s) are ['10.4.3.26', 'fe80::f816:3eff:fe9d:a460', '192.168.40.6', 'fe80::f816:3eff:fe03:3412', '192.168.50.6', 'fe80::f816:3eff:fe2e:6fc8', '192.168.10.6', 'fe80::f816:3eff:fe2a:7a5f', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::c864:7ff:fe95:4646', 'fe80::fc16:3eff:fe7a:11ff', 'fe80::68e8:f7ff:fea1:337f'] 
May 13 04:37:49.816178 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 04:37:49.816273 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.lightos [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] LIGHTOS: no hostnqn found. {{(pid=97951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 04:37:49.816531 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.26', 'host': 'np0000000669', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:d7e5e123a865', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'd26a2911-da70-41c4-bf1f-498a5fdc91e4', 'nvme_native_multipath': False} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:37:49.816769 np0000000669 nova-compute[97951]: DEBUG nova.virt.block_device [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating existing volume attachment record: e0787541-cac4-4208-8913-47db56fd6aa0 {{(pid=97951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 04:37:49.928733 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:50.357415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Calling os-brick to attach iSCSI Volume {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 04:37:50.357736 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:37:50.357868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:37:50.358271 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:37:50.358507 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 04:37:50.369194 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:37:50.369812 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:37:50.370300 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:37:50.370488 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:37:50.370853 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:37:50.371050 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:37:50.382503 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:37:50.382503 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:50.386953 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 04:37:50.386953 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:50.392729 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b] added
May 13 04:37:50.392729 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:37:50.392729 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:37:50.392729 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:37:50.392729 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:37:50.392729 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:37:50.392729 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:50.392930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:37:50.393070 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:37:50.393223 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:37:50.396971 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b] added
May 13 04:37:50.396971 np0000000669 nova-compute[97951]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 04:37:50.396971 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:37:50.396971 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:37:50.396971 np0000000669 nova-compute[97951]: iscsiadm: Config file line 363 does not have value
May 13 04:37:50.396971 np0000000669 nova-compute[97951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 04:37:50.396971 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:50.397114 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 04:37:50.397284 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 04:37:50.397447 np0000000669 nova-compute[97951]: DEBUG os_brick.utils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 04:37:50.891601 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:51.083787 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:51.083940 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:37:51.084177 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:51.393678 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 04:37:51.398341 np0000000669 nova-compute[97951]: INFO os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.40.100
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:37:51.404870 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:37:51.404870 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.name = iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.tpgt = -1
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.startup = manual
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.leading_login = No
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.iscsi_ifacename = default
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.net_ifacename = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.ipaddress = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.prefix_len = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.hwaddress = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.transport_name = tcp
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.initiatorname = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.vlan_id = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.vlan_priority = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.vlan_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.iface_num = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.mtu = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.port = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.bootproto = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.subnet_mask = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.gateway = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_alt_client_id = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_dns = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_learn_iqn = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_req_vendor_id_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_vendor_id = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.dhcp_slp_da = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.fragmentation = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.gratuitous_arp = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.incoming_forwarding = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tos_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tos = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.ttl = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.delayed_ack = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tcp_nagle = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tcp_wsf_state = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tcp_wsf = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tcp_timer_scale = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.tcp_timestamp = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.redirect = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.def_task_mgmt_timeout = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.header_digest = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.data_digest = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.immediate_data = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.initial_r2t = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.data_seq_inorder = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.data_pdu_inorder = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.erl = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.max_receive_data_len = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.first_burst_len = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.max_outstanding_r2t = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.max_burst_len = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.chap_auth = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.bidi_chap = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.strict_login_compliance = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.discovery_auth = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: iface.discovery_logout = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.discovery_address = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.discovery_port = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.discovery_type = fw
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.initial_cmdsn = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.initial_login_retry_max = 8
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.xmit_thread_priority = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.cmds_max = 128
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.queue_depth = 32
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.nr_sessions = 1
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.authmethod = None
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.username = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.password = ***
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.username_in = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.password_in = <empty>
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.auth.chap_algs = SHA256
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.timeo.replacement_timeout = 120
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.err_timeo.abort_timeout = 15
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.err_timeo.lu_reset_timeout = 30
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.err_timeo.host_reset_timeout = 60
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.FastAbort = Yes
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.InitialR2T = No
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.ImmediateData = Yes
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.FirstBurstLength = 262144
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.MaxBurstLength = 16776192
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Retain = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.DefaultTime2Wait = 2
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.MaxConnections = 1
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.iscsi.ERL = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.scan = auto
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.session.reopen_max = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].address = 192.168.50.100
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].port = 3260
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].startup = manual
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].tcp.window_size = 524288
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].tcp.type_of_service = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].timeo.logout_timeout = 15
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].timeo.login_timeout = 15
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].timeo.auth_timeout = 45
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_interval = 5
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].timeo.noop_out_timeout = 5
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.HeaderDigest = None
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.DataDigest = None
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.IFMarker = No
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: node.conn[0].iscsi.OFMarker = No
May 13 04:37:51.409748 np0000000669 nova-compute[97951]: # END RECORD
May 13 04:37:51.409748 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:51.415298 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:51.420443 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:51.424652 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:37:51.424652 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:37:51.424786 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:37:51.424786 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:37:51.424876 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:37:51.424876 np0000000669 nova-compute[97951]: 
May 13 04:37:51.429692 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 04:37:51.429692 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:37:51.429824 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 04:37:51.429824 np0000000669 nova-compute[97951]:  {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:37:51.429924 np0000000669 nova-compute[97951]: WARNING os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 04:37:51.429924 np0000000669 nova-compute[97951]: 
May 13 04:37:52.453579 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.40.100,3260]
May 13 04:37:52.453579 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.40.100,3260] successful.
May 13 04:37:52.453579 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:52.463223 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.50.100,3260]
May 13 04:37:52.463223 np0000000669 nova-compute[97951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.50.100,3260] successful.
May 13 04:37:52.463223 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:52.463754 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:52.473908 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:52.478359 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.478359 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.478359 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:37:52.478593 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.478593 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.478593 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:37:52.478723 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.108s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:37:52.478817 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.40.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:37:52.479284 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:37:52.479489 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:37:52.485495 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.485495 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.485495 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:37:52.485698 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.485698 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:52.485698 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:37:52.486032 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.115s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:37:52.486177 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to 192.168.50.100:3260 {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 04:37:52.486715 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] HCTL ('8', '-', '-', 0) found on session 228 with lun 0 {{(pid=97951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 04:37:52.486847 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 04:37:52.491779 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:37:52.492012 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:37:52.500521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 04:37:52.500521 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 04:37:53.079137 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:37:53.079474 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:37:53.371458 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 04:37:54.385882 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found WWN 33000000093b611a1 for multipath device dm-0 {{(pid=97951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 04:37:54.386260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:37:54.386260 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '33000000093b611a1', 'path': '/dev/dm-0', 'multipath_id': '33000000093b611a1'} {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:37:54.386396 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000093b611a1', 'path': '/dev/dm-0', 'multipath_id': '33000000093b611a1'} {{(pid=97951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 04:37:54.390012 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:37:54.893197 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Attempting to attach volume 0d8fac2e-cf42-40d3-90e7-f13a97911b2b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 04:37:54.896147 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] attach device xml: <disk type="block" device="disk">
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <alias name="ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b"/>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <serial>0d8fac2e-cf42-40d3-90e7-f13a97911b2b</serial>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]: </disk>
May 13 04:37:54.896147 np0000000669 nova-compute[97951]:  {{(pid=97951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 04:37:54.930131 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:37:56.527441 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:37:56.527972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:37:56.527972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No BDM found with device name hda, not building metadata. {{(pid=97951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 04:37:56.527972 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] No VIF found with MAC fa:16:3e:7a:11:ff, not building metadata {{(pid=97951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 04:37:58.069377 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-df9bc809-2088-4d19-95ef-0e847828cff7 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.364s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:37:58.548349 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:37:58.548568 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:37:59.050531 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Detaching volume 0d8fac2e-cf42-40d3-90e7-f13a97911b2b
May 13 04:37:59.084771 np0000000669 nova-compute[97951]: INFO nova.virt.block_device [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Attempting to driver detach volume 0d8fac2e-cf42-40d3-90e7-f13a97911b2b from mountpoint /dev/vdb
May 13 04:37:59.089360 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:37:59.090255 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Found disk vdb by alias ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b {{(pid=97951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 04:37:59.090415 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Attempting to detach device vdb from instance 3ce5422b-a042-45cc-853b-42bf60b29f6f from the persistent domain config. {{(pid=97951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 04:37:59.090675 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <alias name="ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b"/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <serial>0d8fac2e-cf42-40d3-90e7-f13a97911b2b</serial>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]: </disk>
May 13 04:37:59.090675 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:37:59.095067 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance 3ce5422b-a042-45cc-853b-42bf60b29f6f from the persistent domain config.
May 13 04:37:59.095252 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] (1/8): Attempting to detach device vdb with device alias ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b from instance 3ce5422b-a042-45cc-853b-42bf60b29f6f from the live domain config. {{(pid=97951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 04:37:59.095555 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.guest [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] detach device xml: <disk type="block" device="disk">
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <alias name="ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b"/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <source dev="/dev/dm-0"/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <target dev="vdb" bus="virtio"/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <serial>0d8fac2e-cf42-40d3-90e7-f13a97911b2b</serial>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <shareable/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]: </disk>
May 13 04:37:59.095555 np0000000669 nova-compute[97951]:  {{(pid=97951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 04:37:59.549745 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Received event <DeviceRemovedEvent: 1778647079.5493555, 3ce5422b-a042-45cc-853b-42bf60b29f6f => ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b> from libvirt while the driver is waiting for it; dispatched. {{(pid=97951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 04:37:59.550433 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0d8fac2e-cf42-40d3-90e7-f13a97911b2b for instance 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 04:37:59.552725 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully detached device vdb from instance 3ce5422b-a042-45cc-853b-42bf60b29f6f from the live domain config.
May 13 04:37:59.578459 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] calling os-brick to detach iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 04:37:59.578748 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7a46480ffd10>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 04:37:59.578885 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 04:37:59.579161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 04:37:59.579441 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 04:37:59.579558 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', 0)] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 04:37:59.600022 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:59.600022 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:59.600022 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 04:37:59.600198 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:59.600198 np0000000669 nova-compute[97951]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b (non-flash)
May 13 04:37:59.600198 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 04:37:59.600270 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', '228')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 04:37:59.600358 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', '227')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:37:59.601099 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b', '228')] {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 04:37:59.601759 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7a4648128400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'): ({'sdc'}, set())}) {{(pid=97951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 04:37:59.601940 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Removing multipathed devices sdb, sdc {{(pid=97951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 04:37:59.602161 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Flush multipath device 33000000093b611a1 {{(pid=97951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 04:37:59.632733 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:37:59.669868 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 04:37:59.717701 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 04:37:59.717871 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=97951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 04:37:59.718446 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 04:37:59.728996 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.linuxscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=97951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 04:37:59.729152 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b')] {{(pid=97951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 04:37:59.739110 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.769075 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.40.100,3260]
May 13 04:37:59.769075 np0000000669 nova-compute[97951]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.40.100,3260] successful.
May 13 04:37:59.769075 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.780068 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.789479 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.812930 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.50.100,3260]
May 13 04:37:59.812930 np0000000669 nova-compute[97951]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-0d8fac2e-cf42-40d3-90e7-f13a97911b2b, portal: 192.168.50.100,3260] successful.
May 13 04:37:59.812930 np0000000669 nova-compute[97951]:  stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.822985 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 04:37:59.823230 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.base [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 04:37:59.823398 np0000000669 nova-compute[97951]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] <== disconnect_volume: return (244ms) None {{(pid=97951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 04:37:59.823556 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Disconnected iSCSI Volume {{(pid=97951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 04:37:59.931912 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:00.365151 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'flavor' on Instance uuid 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:38:01.369763 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-51fcffc8-fed4-4f0b-bf7c-1e584a4987e0 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.821s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:02.857901 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:02.858391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:02.858391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:02.858391 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:02.858493 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:02.860289 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Terminating instance
May 13 04:38:03.362817 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Start destroying the instance on the hypervisor. {{(pid=97951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 04:38:03.373925 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.376009 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.391737 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.406883 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.535564 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:38:03.535766 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:03.536080 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:03.536201 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:03.536348 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] No waiting events found dispatching network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:38:03.536472 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-e983449b-ac84-4376-8ef2-258b3e0db33c req-42dca3d7-a063-40d1-abe0-a259b2152491 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:38:03.569855 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.647650 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.653681 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:03.673005 np0000000669 nova-compute[97951]: DEBUG nova.utils [None req-8d032e0a-ef4e-4935-9fce-edae0e7c0f70 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999684437000269 future=<Future at 0x7a463c15dcd0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:38:03.673423 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999257625000155 future=<Future at 0x7a463c15dcd0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:38:03.673514 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=14.999124185000255 future=<Future at 0x7a463c15dcd0 state=pending>) {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:38:03.675264 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Instance destroyed successfully.
May 13 04:38:03.675642 np0000000669 nova-compute[97951]: DEBUG nova.objects.instance [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lazy-loading 'resources' on Instance uuid 3ce5422b-a042-45cc-853b-42bf60b29f6f {{(pid=97951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 04:38:04.177780 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.vif [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T04:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-964454895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000669',hostname='tempest-volumemultiattachtests-server-964454895',id=81,image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxVcDPPzD3cG/yFNUDfyokHcOeUVgAaf+PBULgSKYm9w7uzznImCJj2YL1FtQMRrWYoEHT2NzPtReZQUBiSGNX4Ilte9HylByIFZ1jEDyIfPGf3nM3cyuir6QZ5Lpvyhw==',key_name='tempest-keypair-31678955',keypairs=<?>,launch_index=0,launched_at=2026-05-13T04:37:19Z,launched_on='np0000000669',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000669',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fede022df634a7aaad4c86c82fe41ad',ramdisk_id='',reservation_id='r-o1iac9ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21f6dd9f-a6e8-4103-9a88-7de2ff01268f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1986363338',owner_user_name='tempest-VolumeMultiattachTests-1986363338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T04:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='183422f277bf46d7a02252f7d9e42744',uuid=3ce5422b-a042-45cc-853b-42bf60b29f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 04:38:04.178291 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converting VIF {"id": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "address": "fa:16:3e:7a:11:ff", "network": {"id": "f63ad34f-f977-411e-9e5f-18e132c30dd4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1484659194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0fede022df634a7aaad4c86c82fe41ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap938742ee-7b", "ovs_interfaceid": "938742ee-7b4d-4922-8ce2-55ba7080f6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 04:38:04.178508 np0000000669 nova-compute[97951]: DEBUG nova.network.os_vif_util [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b') {{(pid=97951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 04:38:04.178757 np0000000669 nova-compute[97951]: DEBUG os_vif [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b') {{(pid=97951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 04:38:04.180041 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:04.180351 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap938742ee-7b, bridge=br-int, if_exists=True) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:38:04.181354 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:04.182434 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:38:04.182920 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:04.183067 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d087f4b3-2963-4941-b922-6bbdeb48fe2c) {{(pid=97951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 04:38:04.183493 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:04.184210 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:38:04.185442 np0000000669 nova-compute[97951]: INFO os_vif [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:11:ff,bridge_name='br-int',has_traffic_filtering=True,id=938742ee-7b4d-4922-8ce2-55ba7080f6b8,network=Network(f63ad34f-f977-411e-9e5f-18e132c30dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap938742ee-7b')
May 13 04:38:04.185731 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Deleting instance files /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f_del
May 13 04:38:04.186425 np0000000669 nova-compute[97951]: INFO nova.virt.libvirt.driver [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Deletion of /opt/stack/data/nova/instances/3ce5422b-a042-45cc-853b-42bf60b29f6f_del complete
May 13 04:38:04.691657 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Took 1.33 seconds to destroy the instance on the hypervisor.
May 13 04:38:04.692172 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._common.loopingcall [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 04:38:04.692462 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Deallocating network for instance {{(pid=97951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 04:38:04.692553 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] deallocate_for_instance() {{(pid=97951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 04:38:04.692800 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:38:04.777698 np0000000669 nova-compute[97951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 04:38:05.118991 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-24c3db9b-c692-4d0f-b7e3-eea3c877ed0f req-d46ce343-27e5-4ca9-bbc9-2d5fa922e6ab service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-deleted-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:38:05.119289 np0000000669 nova-compute[97951]: INFO nova.compute.manager [req-24c3db9b-c692-4d0f-b7e3-eea3c877ed0f req-d46ce343-27e5-4ca9-bbc9-2d5fa922e6ab service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Neutron deleted interface 938742ee-7b4d-4922-8ce2-55ba7080f6b8; detaching it from the instance and deleting it from the info cache
May 13 04:38:05.119432 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [req-24c3db9b-c692-4d0f-b7e3-eea3c877ed0f req-d46ce343-27e5-4ca9-bbc9-2d5fa922e6ab service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:38:05.557393 np0000000669 nova-compute[97951]: DEBUG nova.network.neutron [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Updating instance_info_cache with network_info: [] {{(pid=97951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 04:38:05.591187 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 04:38:05.591350 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] Acquiring lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:05.591621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:05.591844 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:05.591844 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] No waiting events found dispatching network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 {{(pid=97951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 04:38:05.591930 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-dfc68a26-47e0-40a3-91c9-2f66b1b5f288 req-d252a02c-85c6-4d75-b213-5d7068e98b01 service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Received event network-vif-unplugged-938742ee-7b4d-4922-8ce2-55ba7080f6b8 for instance with task_state deleting. {{(pid=97951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 04:38:05.623569 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [req-24c3db9b-c692-4d0f-b7e3-eea3c877ed0f req-d46ce343-27e5-4ca9-bbc9-2d5fa922e6ab service nova] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Detach interface failed, port_id=938742ee-7b4d-4922-8ce2-55ba7080f6b8, reason: Instance 3ce5422b-a042-45cc-853b-42bf60b29f6f could not be found. {{(pid=97951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 04:38:06.059944 np0000000669 nova-compute[97951]: INFO nova.compute.manager [-] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Took 1.37 seconds to deallocate network for instance.
May 13 04:38:06.565040 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:06.565465 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:06.656015 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:38:06.656264 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:38:07.158884 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:38:07.664187 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.099s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:07.703744 np0000000669 nova-compute[97951]: INFO nova.scheduler.client.report [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Deleted allocations for instance 3ce5422b-a042-45cc-853b-42bf60b29f6f
May 13 04:38:08.712136 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-10588479-c5f9-489b-9cda-c83146cc2e03 tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Lock "3ce5422b-a042-45cc-853b-42bf60b29f6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.854s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:09.183708 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:10.688072 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:12.016353 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:14.184913 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:18.673000 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7a4652013470>>, remaining_delay=-0.00031969099973139237 future=<Future at 0x7a463c15dcd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7a46525e6ea0> {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:38:18.673419 np0000000669 nova-compute[97951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97951) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 04:38:18.673419 np0000000669 nova-compute[97951]: DEBUG nova.virt.driver [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] Emitting event <LifecycleEvent: 1778647083.6725872, 3ce5422b-a042-45cc-853b-42bf60b29f6f => Stopped> {{(pid=97951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 04:38:18.673492 np0000000669 nova-compute[97951]: INFO nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] VM Stopped (Lifecycle Event)
May 13 04:38:19.175831 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-176d8d04-8a9c-41b2-b570-ee210e5035ce tempest-VolumeMultiattachTests-1986363338 tempest-VolumeMultiattachTests-1986363338-project-member] [instance: 3ce5422b-a042-45cc-853b-42bf60b29f6f] Checking state {{(pid=97951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 04:38:19.186383 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:24.188581 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:29.189419 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:38:29.189834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:38:29.189834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=97951) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 04:38:29.189834 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:38:29.190137 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:29.190274 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:38:34.190632 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:37.078917 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:37.079357 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:39.083682 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:39.191727 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:39.587952 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:39.588181 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:39.588432 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:39.588550 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Auditing locally available compute resources for np0000000669 (node: np0000000669) {{(pid=97951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 04:38:39.598502 np0000000669 nova-compute[97951]: WARNING nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 04:38:39.599621 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 04:38:39.643853 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.processutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 04:38:39.644216 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Hypervisor/Node resource view: name=np0000000669 free_ram=14551MB free_disk=72.64914321899414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=97951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 04:38:39.644404 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 04:38:39.644636 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 04:38:40.688904 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 04:38:40.689347 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Final resource view: name=np0000000669 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:38:39 up 52 min,  1 user,  load average: 0.35, 1.78, 3.40\n'} {{(pid=97951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 04:38:40.733260 np0000000669 nova-compute[97951]: DEBUG nova.virt.libvirt.driver [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 04:38:40.733514 np0000000669 nova-compute[97951]: DEBUG nova.compute.provider_tree [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed in ProviderTree for provider: 7fc6428b-bc57-40b4-8243-357124d5276c {{(pid=97951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 04:38:41.236019 np0000000669 nova-compute[97951]: DEBUG nova.scheduler.client.report [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Inventory has not changed for provider 7fc6428b-bc57-40b4-8243-357124d5276c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 04:38:41.742798 np0000000669 nova-compute[97951]: DEBUG nova.compute.resource_tracker [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Compute_service record updated for np0000000669:np0000000669 {{(pid=97951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 04:38:41.743288 np0000000669 nova-compute[97951]: DEBUG oslo_concurrency.lockutils [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=97951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 04:38:41.743380 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:42.743514 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:42.743915 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:42.743915 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:44.083575 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:44.084048 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:44.192953 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:46.083685 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:46.084150 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:46.084191 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:49.194875 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:52.083833 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:38:52.083833 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 04:38:52.084495 np0000000669 nova-compute[97951]: DEBUG oslo.service.backend._threading.loopingcall [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.00 seconds {{(pid=97951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 04:38:54.195882 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:38:59.196916 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:04.198529 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:39:04.199052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:39:04.199052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=97951) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 04:39:04.199052 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:39:04.215125 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:04.215125 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:39:09.215892 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:14.220635 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:39:14.221044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 04:39:14.221044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=97951) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 04:39:14.221044 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:39:14.227958 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:14.228101 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 04:39:19.229207 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:24.231208 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:29.232783 np0000000669 nova-compute[97951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 04:39:32.084750 np0000000669 nova-compute[97951]: DEBUG oslo_service.periodic_task [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 04:39:32.084750 np0000000669 nova-compute[97951]: DEBUG nova.compute.manager [None req-e056565b-ba4c-451d-83ae-66cfd67bfc75 None None] Cleaning up deleted instances {{(pid=97951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}